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SYNOPSIS 


In this thesis, the problem of synthesising optimal dynamic routing strategies fc 
some specific network topologies is investigated. This investigation has bee 
carried out within the framework of d5mamic flow models. 

Traffic routing and related areas of network management are currently undei 
going review in many of the existing networks. The concept of dynamic routing 
which allows for the continuous updation of the routing tables depending upon thi 
instantaneous traffic conditions and the network status, is aimed at profiting fron 
the existence of spare capacities in parts of the network while other parts are over- 
loaded. Dynamic routing strategies are known to offer significant improvements 
in the efficiency over static routing strategies, provided a proper exploitation oi 
the traffic variations is carried out. The mam limitation with dynamic routing has 
been that it requires a large amount of data to be processed to perform the complex 
routing calculations. This, however, has been substantially overcome in the re- 
cent times, due to the continued improvements in computer technology. Therefore 
there is a shift in trend towards implementing dynamic routing strategies in both 
packet-switched and circuit-switched networks. State dependent routing schemes 
for telephone traffic, in which the route for a call is chosen on the basis of the 
occupancy-state of trunk groups at call arrival, have received much attention in the 
last few years [1]. 

Along with this shift in trend towards dynamic routing, there has also been a 
growing need to have theoretical frameworks within which, the problem of routing, 
more specifically that of dynamic routing, can be formulated. While traditionally 
traffic phenomena in communication networks have been analysed with queueing 
models [2], these traditional analytical techniques are usually inadequate in dealing 
with networks with, state sensitive dynamics. Queueing analysis is often found to 
be intractable under non-stationary traffic conditions. In the context of routing, 
these descriptive queueing models tell us something at best about the performance 
of a network with a specified routing strategy. Tire task of synthesising the best 
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routing strategy (or at least a good strategy) for a given system is rarely addressed 
to. 

Alternative traffic models, some of which at least are prescriptive [4] in nature, 
have been suggested in the context of traffic control, in the recent times. A sig- 
nificant contribution in terms of providing a modelling scheme which allows the 
synthesis of advanced traffic control rules within the framework of optimal control 
theory was made by J. Filipiak [3]. The approach adopted in [3] is to model the 
network by dynamic flow models. The basic model of dynamic flows relates the 
growth in the amoimt of packages/ messages in the system, by means of a deter- 
ministic differential equation, to the intensity of newly arriving traffic, intensity of 
traffic discarded by the system and the intensity of successfully delivered traffic. It 
was assumed by Filipiak in [3] that the intensity of outgoing traffic can be approx- 
imated by a (non-linear) function of the system state. The work m this thesis starts 
with this framework. 

In a packet switching context, it is reasonable to assume that the flow out from 
any buffer onto its associated link will increase with increasing buffer occupancy, 
and will saturate at a value equal to the channel capacity of the link. It is also 
reasonable to assume that the flow out will be zero when the buffer is empty. 
Based on these considerations, we concentrate in this thesis, on a model in which 
the flow out function increases linearly with the buffer occupancy and saturates 
at a value equal to the channel capacity of the link. Apart from these practical 
reasons, as against more complex form of functions for the flow out given in [3], 
we consider that, this class of models (in which the flowout increases linearly with 
buffer occupancy and saturates at the channel capacity of the link) will make an 
interesting study in itself. The emphasis in our work is therefore on this model. 

The possibility of treating the network as a dynamical system with the routing 
variables as control variables, allows us to formulate the problem of optimal dy- 
namic routing as an optimal control problem. This problem is solved by a well 
known technique of optimal control theory, namely Pontryagin's Maximum Prin- 
ciple. The necessary conditions the optimal solution has to satisfy are specified in 
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terms of a two point boundary value problem in the state and costate variables. 
It is well known that it is not easy to obtain the solution to these equations. The 
problem becomes more complicated when the dimension of the network is large, 
since the dimensionality of the system of differential equations in the state and 
costate variables also increases correspondingly. The emphasis in Filipiak's work 
[3] is to consider the steady-state solution to the costate variables when the dura- 
tion of network operation tends to infinity. Under this assumption, the solution 
to the costate variables (steady state) can be obtained by solving a set of algebraic 
equations. 

In this thesis, we relax the assumption of an infinite time duration operation of 
the network. Since in practice, networks are subjected to shut downs and need 
rebooting from time to time, we consider that the assumption of a finite time 
duration of operation corresponds to a practically more realistic situation. 

An optimal dynamic routing strategy is defined as one which minimises the 
total buffer occupancy time. The rationale for choosing this is that a waiting cost is 
incurred at a rate proportional to the number of customers in the system. 

Since large networks can be viewed as being composed of simpler network struc- 
tures, the problem of synthesising optimal (or at least good suboptimal) routing 
strategies for these large networks can be approached by synthesising them for 
the simpler network units. With this perspective, we investigate the problem of 
optimal routing in two simple structures namely a two node unit and a three node 
unit in this thesis. We also consider some network topologies which are composed 
of these units. The main results regarding the nature of optimal routing strategy 
for these network structures are summarised below. 


Main Results 

The thesis is organised into six chapters. In Chapter 1, we gi\'e a control-theoretic 
perspective to routing and state the motivations as well as the contributions of this 
thesis. 
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In Chapter 2 we review the various modelling schemes used in the performance 
study of networks. We review the dynamic flow model proposed by Filipiak [3] 
in detail and highlight the reasons for the choice of this modelling scheme in the 
synthesis of traffic control rules. A brief survey of routing strategies employed 
both in the context of circuit switched networks and packet switched networks is 
also presented in this chapter. 

In Chapter 3, we investigate the problem of optimal routing in a two node 
network, in which the faster link has a finite channel capacity. Under the assumption 
that the initial buffer occupancy on the faster link is below the saturation value (we 
argue that this assixmption, though may appear to be overly restrictive, is not quite 
so in practice), we derive the set of equations in terms of the link parameters and the 
input traffic, the solution to which specifies the optimal routing strategy. Solution to 
these equations requires the knowledge of the load pattern for the entire duration 
of network operation, and this in turn necessitates an off-line computation. We 
therefore propose an on-line implementable suboptimal routing strategy for this 
network. Some numerical examples comparing the performances of the optimal 
and suboptimal strategies are given. 

In Chapter 4, we investigate the problem of optimal routing in a three node 
network. We start with the assumption that all the links of the network have 
infinite channel capacities. The optimal routing strategy in this case is bang-bang 
and can be completely specified in terms of a single switching instant. The equation 
that specifies this switching instant is also obtained in terms of the link parameters 
of the network and the duration (T) of operation of the network. It is shown that 
the optimal routing strategy has the loop-free property. 

We then relax the assumption of infinite channel capacities and consider the case 
wherein one of the direct links has finite channel capacity. We show that the loop-free 
property holds good under this situation also. The routing strategy is not bang-bang 
in nature (we provide examples wherein the routing variables take non-zero, non- 
unity values over intervals). The various modes of network operation are defined 
and it is shown that out of the 27 possible modes of operation of the network, the 



optimal routing strategy admits only four of these in a terminal interval. These 
cases are illustrated with examples. 

We then impose certain additional assumptions on the link parameters of the 
network, which in practical terms imply that corresponding to a situation in which 
all the links have infinite channel capacities, the optimal routing strategy is to route 
the entire traffic arriving at a source node onto the direct link for the entire duration 
of network operation. Under the assumption that the initial buffer occupancy 
on the link with finite channel capacity is below the saturation value, the set of 
equations (in terms of the link parameters and the input traffic) required to specifies 
the optimal routing strategy is derived. Solution to these equations requires the 
knowledge of the load pattern for the entire duration of network operation and this 
in turn necessitates an off-line computation of the routing strategy. As in the case 
of Chapter 3, we propose an on-line implementable suboptimal strategy for this 
network. Some numerical examples comparing the performance of the optimal 
and suboptimal routing strategies are given. 

In the final section of Chapter 4, we investigate the case wherein the flow out 
on a link is an exponential function of the (associated) buffer occupancy. The opti- 
mal routing strategy in this case is obtained by numerically solving the two point 
boundary value problem in the state and costate variables. From the numerical 
investigations carried out for various choice of link parameters, initial buffer occu- 
pancies and input traffic, we conjecture that the optimal routing strategy has the 
loop-free property. It is also observed that there is at most one switching instant and 
that the network operation always ends with a direct routing of packets at both the 
source nodes. 

In Chapter 5, we investigate the problem of optimal routing in some specific 
networks which can topologically be viewed as being composed of the two node 
network units and the three node network units. We first consider a network which 
is a cascade of n two node units considered in Chapter 3. For the case wherein 
rn of such network imits have their faster link of finite channel capacity (both the 
links of the remaining (n - m) units are assumed to be of infinite channel capacity) 
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we study the properties of the optimal routing strategy. It is proved that in all 
the network units which have both the links of infinite channel capacity all of the 
incoming traffic is routed onto the faster link for the entire duration of network 
operation. We then consider the specific case where only one unit has a link of 
finite charmel capacity. Under the assumption that the network operation starts 
with an initial buffer occupancy in this unit which is less than the saturation value 
(of the buffer associated with the link of finite channel capacity), we derive the set of 
equations required to specify the optimal routing strategy. Since the solution to this 
set of equations require the knowledge of the traffic pattern for the entire duration 
of network operation, and this in turn necessitates an off-line computation, an 
on-line implementable suboptimal algorithm is suggested along the lines as done 
for the individual unit in Chapter 3. Some numerical examples comparing the 
performance of the optimal and suboptimal strategies are given. 

We then consider a network topology composed of the three-node structure of 
Chapter 4. In Chapter 4, we have specified the optimal routing strategy for the 
constituent unit in terms of a single switching instant, when all the links of this 
unit are of infinite channel capacity. We consider a situation in which all the units 
of this larger topology have links of infinite channel capacity. The globally optimal 
strategy for this network is bang-bang in nature and is independent of the input 
traffic. The performances of the network under the globally optimal strategy and 
under the strategy synthesised from locally optimal strategies for the constituent 
imits are compared for various choice of network parameters in order to get a 
quantitative idea of the performance difference. 

Finally we consider a four-node hub network in Chapter 5, which can be topo- 
logically viewed as being composed of the three-node units of Chapter 4. Under 
the assumption that all the links of this network have infinite channel capacity, we 
investigate the nature of optimal routing strategy in this network. It is shown that 
the optimal routing strategy for this network has certain interesting properties as 
in the case of the constituent unit. The network operation ends with a direct rout- 
ing of packets at all the three source nodes. The optimal routing strategy for this 
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network also, is shown to have the loop-free property. The conditions on the link 
parameters under which the optimal strategy for this network is the same as that 
synthesised from the locally optimal strategies for the constituent units, is obtained. 
When these conditions are not satisfied, a suboptimal way of traffic routing in this 
network can be obtained from the locally optimal strategies for the network units. 
We compare the performance of this algorithm with that of the optimal one in or- 
der to get a quantitative idea of the difference (in performance). Finally in Chapter 
6, we summarise the major results in this thesis and indicate some directions for 
future research. 
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Chapter 1 
Introduction 


1.1 The Problem of Routing : A Control-Theoretic 
Perspective 

Considerable amount of attention has been devoted in the recent past, to an inves- 
tigation of efficient traffic control rules for commimication networks. Among the 
many aspects of traffic control, an important one which has been intensively stud- 
ied is the problem of synthesising an efficient routing strategy. A routing strategy^ 
provides a set of rules that specifies the flow of messages or packets through the 
network from the source to the destination. At any switch along the path, the 
input traffic is routed from its input line to one of the output lines according to 
this (specified) set of rules and the destination of packet. An improperly conceived 
routing strategy could cause inefficient utilisation of the network resources, unduly 
long delays, and sometimes loss of message integrity because of out-of-sequence 
and duplication of packets. The problem of obtaining efficient routing strategies 
for fast and reliable delivery of messages to their destination, is therefore of utmost 
importance in the operation of modem data and voice communication networks. 

Based on how the routing strategies incorporate the variations in the traffic 

^also termed as routing algorithm/procedure /policy in literature. In this thesis too, these terms 
are used interchangeably. 
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and/or the network conditions, they can be classified into the following three 
categories^ 

• static routing strategies, 

• quasi-static routing strategies, 

• dynamic routing strategies. 

In a purely static situation, given fractions of the traffic at node i of the network 
destined for each of the other nodes j i are directed on each of the links outgoing 
from node i. These fractions are decided upon before the network starts operation, 
and are fixed in time and depend only on the time and ensemble averages of the 
message flow requirement. 

In the case of quasi-static routing, changes of routes are allowed only at given 
intervals of time and/or whenever extreme situations (eg. link failure) occur. The 
time intervals between routing changes will usually be relatively long, so that 
most of the time messages will be delivered in order and wiU not need individual 
addressing, but on the other hand, if a link fails or recovers or if the traffic and 
delays build up in a particular section of the network, the routing will be changed 
accordingly. 

The completely dynamic strategy, on the other extreme, allows continuous 
changing of routes depending upon the instantaneous system states and traffic 
conditions. 

One of the best known analytical model for static routing in data commimication 
networks is that proposed by Kleinrock in 1962 [14]. The salient features of this 
routing strategy are the following: 

In [14], it was assumed that messages arrive from outside the network to the 
nodes according to independent constant rate Poisson process, and their lengths 
were assumed to be independent exponentially distributed random variables, and 

^Although this classification is extensively found in the literature, the distinction between these, 
is somewhat artificial- It is often difficult to draw precise boundaries bebveen them. 
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independent of the arrival times. It was assumed^ that the service time of a message 
is chosen independently at each node in the analysis. Based on an M/M/1 queue 
analysis, the delay in the steady state in each link is calculated explicitly as 

j~\ / 

(Clm — flm) 

where 

flm is the flow in link (/, m) in messages/second. 

Clm is the capacity of link (Z, m) in messages /second. 

Dim is the total delay/ unit time experienced by all the messages in link 

The routing procedure is so obtained as to minimise the total delay over the entire 
network Dt = Am- 

While static routing algorithms such as the one suggested in [14] and various 
other types are still employed in many networks today and are relatively simple to 
implement, changing situations in real networks, such as a line failure or a change 
in the traffic distribution, necessitates some degree of adaptivity. The adaptive 
routing algorithms must perform the following functions [1]: 

(1) Measurement of the network parameters pertinent to the routing strategy. 

(2) Forwarding of the measured information to the point(s) (Network Control 
Centre (NCC) or nodes) at which routing computation takes place. 

(3) Computation of routing tables. 

(4) Conversion of routing table information to packet routing decisions. 

Dynamic routing procedures which incorporate the above adaptive features, 
are known, to offer significant improvement in the efficiency provided a proper 
exploitation of the regular and random traffic variations is carried out. While the 
additional computational overheads for the implementation of the above men- 
tioned functions are high, the emergence of faster computing machines and the 


^known as the Kleinrock's Independence assumption. 
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continuing improvements in computer technology, has reduced this problem to a 
large extent. Therefore there is a shift in trend from static routing algorithms to 
dynamic routing algorithms in the recent times [9,10,11]. Many of the computer 
communication networks such as ARPANET, TELENET and TYMNET currently 
use d5mamic routing algorithms to compensate for input traffic variations and 
to respond to changes in topology, and to take advantage of temporary changes 
in loading in different paths. Such a trend (from static to dynamic routing) is 
perceived in the case of circuit-switched networks also. State-dependent routing 
schemes for telephone traffic, in which the route for a call is chosen on the basis of 
the occupancy-state of the trunk groups at call arrival, have received much atten- 
tion in the last few years [16,17,18,19]. An excellent survey of the various dynamic 
routing strategies employed in circuit-switched networks is given in [15]. 

Given the above scenario, let us look at the theoretical frameworks within which 
the problem of routing, and more specifically that of dynamic routing, has been 
investigated. Although there is an abundance of literature available on all the 
three categories of routing algorithms [that have been] implemented in the existing 
networks, [1,2,3 ,4, 5], it appears that there is a paucity of basic models and theories 
which are capable of providing deeper analytical insights into them. Such a lack of 
analytical insight renders the task of a quantitative comparison of the performances 
of these algorithms very difficult. Intuition, heuristics, and simulation, rather than 
a detailed and rigorous analysis, have very often been the basis for the selection of 
a routing algorithm in many of the existing networks. While traditionally traffic 
phenomena in communication networks have been analysed with queueing mod- 
els [6,7], these traditional analytical techniques are usually inadequate in dealing 
with networks with state sensitive dynamics. Classical queueing models, being 
too microscopic in their description, very often lead to overwhelmingly complex 
system models. Besides, under non-stationary environments queueing analysis is 
very often found to be intractable. Perhaps the most serious limitation to the use of 
queueing models in the context of routing is that, these descriptive queueing mod- 
els tell us something at best about the operating characteristics of an existing (or 
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proposed) system, operated under a specified control policy [eg: routing strategy]. 
The task of synthesising the best (or at least a good) control policy for a system is 
seldom addressed to. 

An increasing number of alternative models some of which at least, are pre- 
scriptive [50] in nature (as opposed to descriptive queueing models) have been 
proposed in the context of traffic control (flow control and routing ) of networks in 
the recent times. The following studies reported in the literature illustrate this: 

• T.Yum and M.Schwartz [9] considered the approach of superimposing a lo- 
cally adaptive algorithm (called join-biased-queue QBQ) rule) on a fixed traf- 
fic flow distribution obtained from the best stochastic (BS) rule suggested in 
[20]. The resultant JBQ-BS rule was analysed on small networks and has been 
shown to provide certain delay improvement over the BS rule. 

• G.Foschini and J.Salz [10], using the framework of diffusion theory, have 
analysed a dynamic routing strategy where messages arriving at a certain 
node are routed to leave the node on the link having shorter queue. 

• F.H.Moss and A.Segall [11] have investigated the application of optimal con- 
trol theory to the problem of dynamic routing in networks. 

• A learning automata based approach to routing in telephone networks has 
been developed by Narendra and Thathachar [8]. Chr}'stall and Mars have 
investigated the use of learning automata in the case of message switched 
traffic. 

• The framework of Markovian decision theory has been used to describe the 
routing of calls in circuit-switched networks. An excellent introduction to 
this is given in [29]. 

Thus, a growing need to incorporate adaptivity (to the changes in the network 
conditions and/or the traffic pattern) and the need to incorporate a synthesis 
approach rather than an analysis approach have resulted in the introduction of 
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estimation and optimal control methods also in the design of flow control and rout- 
ing algorithms. A significant contribution in this direction in terms of providing a 
systematic approach to the synthesis of advanced traffic control rules (within the 
framework of optimal control theory) was made by J.Filipiak [21]. The approach 
adopted by him in [21] consists in the modelling of dynamic flows. The basic 
model of d3mamic flows relates the growth in the amount of packets /messages 
in the system at time t, by means of a deterministic differential equation, to the 
following three quantities: 

(i) The intensity of newly arriving traffic 

(ii) The intensity of traffic discarded /rejected by the system and 

(iii) The intensity of successfully delivered traffic. 

Expressed mathematically, 

x(t) = -[X%t) + A’-{f)] + (1.1) 


where 

x(t)= amount of traffic in the system at time t 
A'”(f)=mtensity of newly arriving traffic 

A’'(t)=intensity of traffic discarded or rejected by the system, and 
A‘^(t)= intensity of successfully delivered traffic. 

It was assumed by Filipiak [21] that the intensity of the outgoing traffic -H 
A''(f) can be approximated by a non-linear function ixG{x) of the system state x(t). 
The intensity of arriving traffic A‘"(f) is the fraction a(t) of the total traffic arriving 
at the node from which the link originates. 

Thus the state of the network at time t, X(i) can be given by the differential 
equation: 

X = l(X,a,m (1-2) 
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In the Equation (1.2) above, 


.Y = 




where Xjk{t) denotes the number of packets in the buffer associated with link {jk) 
at time t. 


where ajk{t) denotes the fraction of the total traffic arriving at node j, routed onto 

link {jk), 

and 


Ai(f) 

X2{t) 

K{t) 


where Xi{t) is the total external traffic arriving at node i. 

The problem of optimal routing (dynamic routing) is then formulated as finding 
the a{t) such that a suitably chosen performance functional is optimised. A detailed 
description of this approach is given in Chapter 2 of this thesis. 


1.2 Motivation for this Thesis 

As mentioned in the previous section, the possibility of treating the network as a 
dynamical system within the dynamic flow model formulation allows us to apply 
the powerful apparatus of optimal control theory for the synthesis of optimal 
traffic routing strategies. Using a familiar technique of optimal control theory, 
namely Pontryagin's Maximum principle, the necessary conditions the optimal 
state, costate and the control (routing) variables have to satisfy can be obtained. 
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These necessary conditions are given by a two point boundary value problem in 
the set of state and costate variables. It is well known that it is not easy to obtain 
the solution to these equations because the transversality conditions (boundary 
conditions) fix the values of the costate variables at the end of the time interval. 
The problem becomes more complicated when the dimensions of the network is 
large, since the dimensionality of the system of differential equations in the state 
and costate variables also increases correspondingly. The emphasis in Filipiak's 
work [21] is to consider the steady-state solution to the costate variables when the 
duration of the network operation T tends to infinity. Under this assumption, the 
solution to the costate variables (steady state) can be obtained (and from which the 
optimal routing variables) by solving a set of algebraic equations. 

In this thesis, we relax this assumption of an infinite time duration operation 
of the network. Since in practice, networks are subjected to shut downs and 
need rebooting from time to time, we consider that the assumption of a finite 
time duration of operation corresponds to a practically more realistic situation. 
Furthermore, our analysis doesn't impose any restrictions on the value of T, and 
can therefore be viewed theoretically as a more general case (T equals infinity being 
a special case). 

As mentioned in the previous section, the flow out from any buffer onto the 
corresponding fink was assumed to be a non-linear function iiG[x) of the buffer 
occupancy in [21]. In a packet switching context it is reasonable to assume that 
the flow out function increases with increasing buffer occupancy and saturates at 
a value equal to the channel capacity of the link. It is also reasonable to assume 
that the flow out on a link is zero when the buffer is empty. Under these set of 
assumptions, a good approximation to the flow out function is one in which it 
increases linearly with the increase in buffer occupancy and saturates at a value 
equal to the channel capacity of the link. We consider that this class of flow out 
functions (in which they increase linearly with increase in buffer occupancy and 
saturate at the channel capacity) as against more complex form of functions for 
the flow out given in [21], will make an interesting study in itself. The emphasis 
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in our work is on this model. A different context in which such a model best 
describes a practical situation, is one in which the network is operating under a 
steady state (under a static routing strategy) and the sudden traffic fluctuations 
(perturbations) are to be routed (dynamically) in the network so as to achieve 
optimality. A linearized flow model, we consider, will best describe this practical 
situation. 

The performance functional which is chosen (in this thesis) to be optimised is the 
total buffer occupancy time. The rationale behind choosing this is that a waiting 
cost is incurred at a rate proportional to the number of customers in the system. 
Hence whenever we use the term optimal routing strategy in this thesis, we mean 
a routing strategy which minimises the total buffer occupancy time for the entire 
duration of network operation. 

Thus having chosen the flow model and the performance criterion to be opti- 
mised, we approach the problem of synthesising the optimal routing strategy for a 
large network in the following manner. 

• Identify simpler structures within the large network. 

• Obtain the optimal (or at least a good suboptimal) routing strategy for these 
simpler structures. 

• Synthesise the routing strategy for the large network from the locally opti- 
mal /suboptimal routing strategies. 

This thesis is motivated by the need to study the nature of optimal routing strategy 
and to specify it, in simple network units which are constituents of larger networks. 
We identify two such simple structures, namely a two-node structure (given in 
Chapter 3), and a three-node structure (given in Chapter 4). The problem of 
optimal routing in these network units is investigated in detail and the optimal 
routing strategy is specified under certain practically realistic assumptions. When 
the specification of the optimal strategy requires off-line computation, we suggest 
an on-line implementable suboptimal strategy for the network units. We also 
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look at some network topologies which are composed of these network units and 
study the properties of the optimal routing in these networks in Chapter 5. The 
main contributions from our investigations and the organisation of this thesis is 
summarised in the following section. 

1.3 Contributions and Organisation of the Thesis 

In Chapter 2, we review the various modelling schemes used in the performance 
study of networks. We review the dynamic flow model proposed by Filipiak [21] 
in detail and highlight the reasons for the choice of this modelling scheme in the 
synthesis of traffic control rules. A brief survey of the routing strategies employed 
both in the context of circuit switched networks and packet switched networks is 
also presented in this chapter. 

In Chapter 3, we investigate the problem of optimal routing in a two node 
network/ in which the faster link has a finite channel capacity. Under the assumption 
that the initial buffer occupancy on the faster link is below the saturation value (we 
argue that this assumption/ though may appear to be overly restrictive/ is not 
quite so in practice)/ we derive the set of equations in terms of the link parameters 
and the input traffic/ the solution to which specifies the optimal routing strategy. 
Solution to these equations requires the knowledge of the load pattern for the entire 
duration of network operation/ and this in turn necessitates an off-line computation. 
We therefore propose an on-line implementable suboptimal routing strategy for 
this network. The performance of the optimal and the suboptimal strategies are 
compared in the case of some numerical examples. 

In Chapter 4, we investigate the problem of optimal routing in a three node 
network. We start with the assumption that all the links of the network have 
infinite channel capacities. The implication of this assumption on the network 
operation is that packets can be sent out on the links at a rate proportional to the 
buffer occupancy. The optimal routing strategy in this case is bang-bang and can 
be completely specified in terms of a single switching instant. The equation to 
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specify this switching instant is also obtained in terms of the link parameters of 
the network and the duration (T) of operation of the network. It is shown that the 
optimal routing strategy has the loop-free property. 

We then relax the assumption of infinite channel capacities and consider the 
case wherein one of the direct links has finite channel capacity. We show that the 
loop-free property holds good under this situation also. The routing strategy need 
not be bang-bang in nature (we provide examples wherein the routing variables 
take non-zero, non-unity values over intervals). The various modes of network 
operation are defined and it is shown that out of the 27 possible modes, only 4 are 
valid in a terminal interval. These cases are illustrated with examples. 

We then impose certain additional assumptions on the link parameters of the 
network, which in practical terms imply that corresponding to a situation in which 
all the links have infinite channel capacities, the optimal routing strategy is to route 
the entire traffic arriving at a source node onto the direct link for the entire duration 
of network operation. Under the assumption that the initial buffer occupancy 
on the link with finite channel capacity is below the saturation value, the set of 
equations (in terms of the link parameters and the input traffic) required to specifies 
the optimal routing strategy is derived. Solution to these equations requires the 
knowledge of the load pattern for the entire duration of network operation and this 
in turn necessitates an off-line computation of the routing strategy. As in the case 
of Chapter 3, we propose an on-line implementable suboptimal strategy for this 
network. The performances of the optimal and suboptimal strategies are compared 
in the case of some numerical examples. 

In the final section of Chapter 4, we investigate the case wherein the flow out 
on a link is an exponential function of the (associated) buffer occupancy. The opti- 
mal routing strategy in this case is obtained by numerically solving the two point 
boundary value problem in the state and costate variables. From the numerical 
investigations carried out for various choice of link parameters, initial buffer occu- 
pancies and input traffic, we conjecture that the optimal routing strategy has the 
loop-free property. It is also observed that there is at most one switching instant and 
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that the network operation always ends with a direct routing of packets at both the 
source nodes. 

In Chapter 5, we investigate the problem of optimal routing in some networks 
which can topologically be viewed as being composed of the two node network 
imits and the three node network units. We first consider a network which is 
composed of the two node units composed in Chapter 3. For the case wherein m 
such network units (of the total n which constitute the topology) have iheir faster 
link of finite channel capacity (both the links of the remaining (n — m) units are 
assumed to be of infinite channel capacity) we study the properties of the optimal 
routing strategy. It is proved that in all the network units which have both the links 
of infinite channel capacity, all of the incoming traffic is routed onto the faster link for 
the entire duration of network operation. We then consider the specific case where 
only one unit has a link of finite channel capacity. Under the assumption that 
the network operation starts with an initial buffer occupancy in this unit which 
is less than the saturation value (of the buffer associated with the link of finite 
channel capacity), we derive the set of equations required to specify the optimal 
routing strategy. Since the solution to this set of equations require the knowledge 
of the traffic pattern for the entire duration of network operation, and this in 
turn necessitates an off-line computation, an on-line implementable suboptimal 
algorithm is suggested along the lines as done for the individual unit in Chapter 3. 
The performances of the optimal routing strategy and of the suboptimal strategy 
are compared in the case of some numerical examples. 

We then consider a network topology composed of the three-node structure of 
Chapter 4. In Chapter 4, we have specified the optimal routing strategy for the 
constituent unit in terms of a single switching instant, when all the links of this 
unit are of infinite channel capacity. We consider a situation in which aU the units 
of this larger topology have links of infinite channel capacity. The globally optimal 
strategy for this network is bang-hang in nature and is independent of the input 
traffic. The performances of the network imder the globally optimal strategy and 
under the strategy synthesised from locally optimal strategies for the constituent 
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units are compared for various choice of network parameters in order to get a 
quantitative idea of the performance difference. 

Finally we consider a four-node hub network in Chapter 5, which can be topo- 
logically viewed as being composed of the three-node units of Chapter 4. Under 
the assumption that all the links of this network have infinite channel capacity, 
we investigate the nature of optimal routing strategy in this network. It is shown 
that the optimal routing strategy for this network has certain interesting properties 
as in the case of the constituent unit. The network operation ends with a direct 
routing of packets at all the three source nodes. The optimal routing strategy is 
shown to have the loop-free property also. The conditions on the link parameters 
xmder which the optimal strategy for this network is the same as that synthesised 
from the locally optimal strategies for the constituent units, is obtained. When these 
conditions are not satisfied, a suboptimal way of traffic routing in this network can 
be obtained from the locally optimal strategies for the network units. We compare 
the performance of this algorithm with that of the optimal one in order to get 
a quantitative idea of the difference (in performance). Finally in Chapter 6, we 
summarise the major results in this thesis and indicate some directions for future 
research. 



Chapter 2 


Network Models and Routing 
Strategies: An Overview 


Facilities for collective use are often encountered in a variety of situations in the 
present day society. Ticket windows, beds m a hospital, road junctions, communi- 
cation trunks in a telephone network, the central processing unit in a computer are 
some of the frequently encoimtered examples. These facilities are usually of limited 
capacities, and therefore are prone to phenomena like congestion and loss when 
the demands of the users surpass the capacity. For an efficient (and economical) 
usage, it is essential to evaluate the performance quantitatively and to mcorporate 
methodologies /strategies which enhance the performance. In the specific area of 
telecommunication systems, it is required to evaluate the Grades of Service (GOS) 
quantitatively, and to clarify relations between the GOS and the amount as well 
as configuration of the facilities. This, in turn, necessitates the use of appropriate 
models for the performance analysis of such facilities. 

We mentioned in Chapter 1, that a number of alternative models for traffic and 
network characterisation have emerged in the recent times. Quite apart the ex- 
tensive use of traditional techniques like simulation and queueing analysis, these 
models have also been employed (and perhaps, even substituted the use of tradi- 
tional techniques) in the context of network management. We now review some 



2.1 Simulation Models 


15 


of the important models employed in the performance study of communication 
networks in the first section of this chapter. It is not our claim that what is given 
here is an exhaustive survey of all the models that have been suggested in the 
literature. Such an exhaustive survey is beyond the scope of this thesis. The pre- 
sentation has been made here with a view to highlight the important ones that have 
been suggested in this context. The dynamic flow model, which is the framework 
of our study in this thesis, is explained in detail. We also take a cursory review 
of routing strategies in terms of some of the classifications which have frequently 
been followed in the literature and finally establish the reasons for the choice of 
flow models in the context of routing. 

Broadly speaking, the modelling schemes that are employed in the performance 
evaluation of telecommunication networks can be classified into two major classes, 
namely, the simulation models and the analytical models. 

2.1 Simulation Models 

Simulation is defined [41] as a numerical technique for conducting experiments on 
a digital computer, that involves mathematical and logical models that describe 
the behaviour of the system (or some components thereof) over periods of time. 
The major reason for conducting this experiment on a computer is that it permits 
the study of real system without modifying the system in any way. Due to the 
increasing speed and decreasing cost of electronic computers, as well as develop- 
ment of programming languages particularly suitable for simulations, there has 
been a dramatic increase in the use of computer simulation in the recent years. In 
the context of computer communication networks, simulation is used at various 
stages of design and operation. Some of the main applications of simulation in the 
context of networks are the following : 

• Computer simulation is applied as an alternative approach to cases where 
exact analytical solutions are not available. It is often difficult to arrive at exact 
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analytical solutions in the performance analysis of large-scale communication 
networks with complex congestion and/ or routing control mechanisms. 

• Simulation is used not only for cases wherein analytical solution is not ob- 
tained, but also in the cases where numerical computation of analytical so- 
lution is difficult. It is also used for validating the accuracy of approximate 
solutions. 

• Simulation is used in the various stages of design and operation of networks, 
such as evaluating the performance to confirm the system application range, 
estimating the response to fault and over-load to determine the counter mea- 
sures etc. 

Simulations can be broadly classified into two: 

• Continuous simulation 

• Discrete simulation 

Traffic simulation m the context of commimication networks, is usually discrete- 
event simulation. The discrete state (number of calls/packets) of the system is 
changed by an event of call origination/packet arrival or termination/packet de- 
parture. As showTL in Figure 2.1, there are the following three viewpoints [48] for 
modelling in a discrete-event simulation: event, process and activity. 

(1) Event-oriented Modelling: 

A simulation model is formulated by describing state changes by events such 
as packet arrival or departure. 

(2) Process-oriented Modelling: 

This modelling describes the behaviour of the entity (call /packet) in the 
system. 

(3) Activity-oriented Modelling: 
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Figure 2.1: Viewpoints in Simulation 


This modelling describes the time instants of initiation and termination of 
activities such as call duration and tnmk busy. This method is suitable for 
modelling systems for which holding time depends on the state of the system. 
Since the simulation is performed by scanning the acti\dties, the execution 
time is usually longer than for event-oriented modelling. 

Programming for simulation may be done either in general purpose languages or 
in simulation languages. The main functions of the simulation languages are gener- 
ation of random numbers, execution of time schedules and data saving, statistical 
analysis and output format conversion. 

Although simulation is a powerful technique and is quite extensively used, there 
are certain disadvantages with it. Simulation is often computationally expensive 
and is a time-consuming process (especially if reliable statistics is to be obtained) 
and often not suited for real-time applications. Moreover, the proper design of 
a simulation experiment and the accurate interpretation of the output data are 
themselves difficult tasks. Although several new approaches have been developed 
in the recent years, aiming at improving the efficiency of simulation (in the sense 
of extracting as much information as possible from a single run), much work has 
yet to be done to eliminate the above inadequacies. 
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2.2 Analytical Models 

An analytical model is a representation of the system that specifies a functional 
relationship between the system parameters and a chosen performance criterion 
in terms of mathematical equations. In the context of communication networks, 
the earliest attempt to use analytical models to predict the performance began 
with the pioneering work by the Danish mathematician A.K. Erlang^ on telephone 
switching systems [26,27]. In the voice telephone network, demands for service 
take the form of subscribers initiating a call. Erlang found that given a sufficiently 
large population, the random rate of such calls can be described by a Poisson 
process. An important and perhaps most extensively used tool for analytical 
modelling, namely queueing theory, has its foundations m this work by Erlang. 
The 1920's were basically devoted to the application of his results and it was not 
until the mid-1930s, when Feller [28] introduced the concept of the birth-death 
process that queueing theory was recognised by the world of mathematics as an 
object of serious interest. The later developments in queueing theory occurred in 
the 1940's and 1950's from the contributions made by C. Palm, F. Pollaczek, A. Ya 
Khinchin and others. Much mathematical work stemmed from an important paper 
by D.G.Kendall [34] who introduced the classification of queues by input, service 
mechanism and queue discipline. 

Descriptive queueing models for communication networks are most often based 
on the theory of Markov processes, either in discrete time or in continuous time. 
Markov-process theory makes it possible to set up a system of equations for the 
equilibrium or time-dependent probabilities for the system state (e.g. number 
of customer /packets present). It is sometimes possible to solve these equations 
analytically, often with the aid of transforms as in the case of simple systems such 
as M/M/1 queues. The result may be closed-form expressions for measures of 
effectiveness such as the average number of packets /customers present or the 

^Historically this work by Erlang was done even before probability theory was popular or even 
well developed. 




niean waiting time of a customer. 

Incorporating the effects of stochastic (random) variation in a model of queueing 
system can easily result in mathematical intractability especially if the real system 
is more complicated than the one referred to above. Unfortunately virtually all 
real-world queueing systems are more complicated. There may be more than one 
server or a finite number of places in the buffer. Jobs may balk (refuse to enter 
the system) or renege (leave after entering the system). Different jobs may have 
different priorities and be processed accordingly rather than the order of arrival. 
Jobs may arrive in batches and/or be served in bulk. The server may be turned 
on or off, due to random breakdowns or the need to perform other functions. The 
pattern of job arrivals may exhibit predictable long-rtm variations (e.g. slack versus 
peak periods), in addition to the short-run, stochastic variations. 

Besides the above difficulties, there are other limitations to queueing analysis, 
especially in the context of analysis and s)mthesis of traffic control rules. Some of 
these are [21], 

• Transient solutions can be obtained for simple systems only. 

• The dimensionality of the network model is usually high. 

• Detailed knowledge of time-dependent probabilities is rarely available. 

• Queueing analysis is often difficult for nonstationary traffic and network 

conditions. 

Other teletraffic models, which aim to eliminate, at least some of the above 
difficulties associated with queueing models, have been suggested in the literature. 
The diffusion approximation given below, is sometimes used to avoid the difficulty 
of obtaining explicit transient solutions. We look at this model in detail in the 
following subsection. 
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2.2.1 Diffusion Models 


Diffusion theory has sometimes been successful in providing excellent approximate 
solutions to difficult queueing problems. The approach in diffusion approximation 
is to replace a discrete process like the vector of queue lengths, Q(t), with a contin- 
uous path Markov process with drift, q(t), i.e. a diffusion. The diffusion process 
q(t) has a dynamical description via a stochastic differential equation 

dq{t) = a{q)dt -1- D^^^{q)dw{t) (2.1) 


where the vector a[q) is the differential mean, the matric D^l^{q) is the positive 
definite square root of the differential dispersion matrix and dw(t) is a standard 
zero mean white Gaussian noise process. That is 


a{q) 
and D{q) 


lim/i ^Eiqit h) 

h-^Q 

{dij{q)) 


q{t)) 


liin/i ^E[{qi{t + h) - q{t)){qj(t + h) - qj{t))] 


( 2 . 2 ) 

(2.3) 

(2.4) 


A central result of diffusion theory is that the transition density for q(t) satisfies the 
Fokker-Planck (FP) equation 


^ ^ ^ dak(q)p ^ d^d^y(q)p 

dt % 11 %%■ 


(2.5) 


The equilibrium density, when it exists, satisfies the above equation with |f = 0. 

So the diffusion equilibrium density is obtained by solving a second order par- 
tial differential equation (PDF) while the desired equilibrium probabilities for the 
discrete vector queue satisfy a difference equation. The reason for turning to dif- 
fusion model is that it may be easier to solve a partial differential equation than a 
difference equation. Boundary conditions (BC) that, for example, demand that the 
quantities of interest such as queue lengths be positive are an essential aspect of 
the diffusion formulation. While the hope is that the resulting PDF and BCs will 
be more tractable than the analysis of the original system of difference equations, 
there is of course, no assurance that this will always be the case. 



2.2 Analytical Models 


21 


Diffusion theory has been used by several authors for the analysis of network 
behaviour [35,36/10]. An interesting application of this theory to the problem of 
dynamic routing was provided by G.Foschini and J.Salz in [10] for the case of a 
single node in a data network. The messages, or packets arriving at a certain node 
are routed to leave the node on the Imk having the shorter queue. For a node with 
K outgoing queues, under the assumption of heavy traffic, an optimum dynamic 
routing strategy (in the sense of minimising the average delay) was obtained. 

2.2.2 FH-MRP Input Models 

The Phase-Type Markov Renewal Process is usually used for representing versatile 
renewal and non-renewal processes appearing in modem teletraffic systems, such 
as the ATM for BISDN. A brief explanation of phase-type (PH) distribution is as 
follows: 

In a continuous-time Markov chain with r transient states and a single (r -I- 
1)^‘ absorbing state, suppose that upon entering the absorbing state, the process 
instantaneously jumps to the transient state j, j = 1, 2, 3, ....r, with probability Uj. 
The PH distribution is defined as the inter-visit time to the absorbing state, and is 
characterised by (n, T), where T is the transition rate matrix among the transient 
states, which is an irreducible rxr matrix. The row vector a with component is 
called the initial probability vector. The column vector T° defined by 

T° = -Te 

represents the transition rate from the transient states to the absorbing state, where 
e is the unit column vector with all components equal to 1. The PH distribution 
is said to be in phase j if the tmderlying Markov process is in state j. A renewal 
process with an interarrival time of PH distribution is called a phase-type renewal 
process (PH-RP). 

If we modify the Markov chain above to have n absorbing states, with jumping 
probability from absorbing state i, i = r -f 1, r + 2, ...., r + n, to transient state j, 
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j = 1,2, , r, then the successive visits to the absorbing states constitute the PH- 

MRP, in which inter- visit times follow PH distribution not identical in general and 
correlated with each other. The PH-MRP is said to be in phase j, if the underlying 
Markov chain is so. The PH-MRP is characterised by representation {a, T, T°). The 
n X r matrix a with components aij, and the rxn matrix T° are the extensions of 
the corresponding vectors above, and we have the relation, 

T°e = -Te 

The arrival rate (averaging each PH distribution) is given by 

A = TTT°e 

where tt is the stationary probability vector ofT + T°a satisfying 

7r(r -fT'a) = 0, 

Tre = 1. 

2.2.3 Traffic Model with Burstiness Constraints 

Instead of using a stochastic model for entering traffic, Cruz [30,31] assumed that 
the entering traffic is ''unknown," but satisfies certain regularity constraints. The 
purpose of introducing this characterisation of the traffic was to facilitate the study 
of the following three parameters of the network [30]: 

1. Delay 

2. Buffer Allocation Requirements 

3. Throughput 

The constraints the traffic stream have to satisfy have the effect of limiting its bursti- 
ness hence they were called "burstiness constraints." These burstiness constraints 
of the traffic were formally defined in [30] as below: 
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Cruz first defined the rate function R{t) of a traffic stream flowing on a com- 
munication link as follows: For any y > x, R(t)dt is the amount of data from 
the stream that is transmitted on the link in the interval [x,y]. Thus, in general, 
R{t) represents the instantaneous rate of traffic from the stream flowing on the 
link at time t. The traffic flowing at any point in the network can be characterised 
(partially) using the burstiness constraints in the following way: Let R{t) denote 
the rate function of the traffic. Given a > 0 and p > 0, we say that the traffic 
satisfies the burstiness constraints (cr, p) (and write R ~ (u, p)) if and only if for all 
X, y satisfying y >x the following relationship holds: 

f R < a + p{y-x). (2.6) 

J X 

Thus the traffic stream is said to satisfy a burstiness constraint if the quantity of 
data from the stream contained in any interval of time is less than a value that 
depends on the length of the interval. A different interpretation of the burstiness 
constraints of the traffic is that given any positive number p, there exists a (possibly 
infinite) number Up such that if the traffic is fed to a server that works at rate p while 
there is work to be done, the size of the backlog will never be larger than Up. The 
constant of proportionality p in the above determines the upper bound to the long 
term average rate of traffic flow if such an average rate exists. 

Note that if packets are L bits long, then if R{t) G {0, C}, it is possible that 
ji+L/c ^ ^ foj. some t. Thus if i? ~ (cr, p), then p must satisfy 

(7 > Lil-p/C). (2.7) 

Cruz extended the above notion to more general constraints on the traffic stream 
than in Equation (2.6). Specifically, if 6 is any function defined on the nonnegative 
reals and i? is a nonnegative function such that 

rR < h{:y-x), ( 2 . 8 ) 

Jx 

for all y > X, we write R^b. The function b is assumed to be nondecreasmg here. 

Thus after characterising the traffic (partially), using the above manner, Cruz 
considered several network elements that can be used as building blocks to model 
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a variety of communication networks. Each t 3 ^e of network element was analysed 
by assuming that the traffic entering it satisfies the burstiness constraints. Under 
this assumption boimds were obtained on delay and buffering requirements for 
the network element, and the burstiness constraints that the traffic that exits the 
element were also derived. Communication network models consisting of the 
interconnection of network elements (which are analysed in isolation) operating 
under a fixed routing strategy were considered in [31]. 

The characterisation of the traffic in terms of burstiness constraints is particularly 
of interest in situations wherein the traffic to be handled by the network is highly 
bursty, for instance, by variable rate video compression schemes. The fact that the 
traffic can be characterised by simple parameters that can in principle be negotiated 
between users and the network, makes this model very appealing from the point 
of view of applications, especially in the design of high speed networks for bursty 
traffic. 

2.2.4 C-Quantile Function Models 

In the emerging B-ISDN networks based on As)mchronous Transfer Mode, one of 
the primary issues is the characterisation of heterogeneous traffic issued by mul- 
timedia users. Performing statistical multiplexing requires a finer characterisation 
of the statistical behaviour of the source. In particular, there is a need for mea- 
sures which give insight into the short-term (for bursts) and long-term (average) 
behaviour of the source. 

The motivation behind the definition [37] of the time G-quantile function, given 
below, was the need to distinguish between the long-term tendency (mean rate) 
and short term bursts at the peak rate of the source behaviour, since these param- 
eters entail different constraints on the design of congestion control mechanisms. 
Another important fact is that the performance requirements of the emerging net- 
works in terms of the loss requirements (typically of the order 10"^) places emphasis 
on the tails of distributions which naturally lead to the consideration of quantile 
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measures. We briefly describe the notion of time quantile measures below. 

The notion of time quantile function (and its properties) can best be illustrated 
in the following way. Consider a slotted-frame transmission system like SONET. 
Assume that the cells from the source arrive at discrete-times, i.e. during slots and 
the slot duration be denoted by 9. Let {Nk}k^z be a discrete-time point process and 
let e be any real number such that 0 <G< 1. {Nk denotes the number of arrivals in 
(0, ^'l9]). Define the function Mg of k as follows: 

M^{k) = min{n : Pr{Nk> n) <^} (2.9) 

Mc{k) is called the time £- quantile at time k of process {Nk}. 

Stated alternatively, M^{k) is a measure of the maximum number of arrivals in 
an interval of length k9 for a given probability G- From the definition of Mg(^■), 
the following properties can be easily inferred for the model when there can be at 
most one arrival ia a given slot. 

1 . maxk>Q ^ < 1 . 

For the general discrete-time point process, supk^^^^^ is the maximum num- 
ber of arrivals in a slot. 

2. is a decreasing function of G (for any fixed k) and an increasing function 
of k (for fixed G). 

Mazumdar et al [37] showed that the average rate of arrivals A is related to the 
time G-quantile of the process {iVn} (provided that Nn is ergodic) in the following 
manner: 

MNn) , . _ ^ 

lim — for any 0 <G< 1. 

n-4oo 

Thus the average rate of arrivals can be recovered from the time-quantile of the 
process. The second asymptotic property related to the Mg(n) function is that a 
suitably scaled version converges to the limit of the indices of the dispersion of 
counts and intervals (for the definitions of the terms index of dispersion of counts and 
index of dispersion of intervals, refer to [37]). 
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The two main utilities of the time € -quantile function characterisation of the 
traffic were shown to be the following [37]: 

• The time €-quantile function provides us with a statistical measure to assess 
the comparative performance of traffic streams from various sources. 

• It was shown in [37] that the G-quantile function can be used in connection 
with queue dimensioning. The role of € as a parameter related to the blocking 
probabilities was brought out. 


2,2.5 Learning Automata Based Network Models 


Mathematical models of the network using a class of learning algorithms, and 
studies related to the convergence and asymptotic performance of these algorithms 
have been discussed by several authors [38,39] in the context of traffic routing in 
circuit-switched networks. These models are particularly useful when little is 
known about the response of the enviromnent to actioris of the system. A formal 
description of an automaton is as follows: 

An automaton is defined by the quintuple { X, 0, a, T, G} where. 


X = 

(/> = 
a = 
T = 
b(n-fl) = 
G = 
G : 


The set of inputs to the automaton. 
The set of internal states. 

The set of actions { ui, na, , ctn}- 

The state-transition map at stage n : 
T[(i>(n),a{n),X{n)]. 

The action-selection function : 

0 — )• a. 


The automaton is deterministic or stochastic depending whether T and G are 
deterministic or stochastic. The class of automata considered for routing, called 
variable structure automata are of the form 


(}> = Pl,P2,P3, 
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The states are defined by a probabihty vector, and the action map is the selection 
of an action i with probability 

The environment in which the automaton operates is characterised by a set of 
inputs a(n) and random outputs x^{n) € X. Of special interest is the case where 
the environment output is binary, that is, a reward {x = 0) or a penalty {x = 1). The 
operation of the automaton is as follows: The automaton outputs are fed into the 
environment, which reacts to these outputs by providing a reward or penalty. This 
response is fed back as input to the automaton, which provides another action, 
and so on. A learning behaviour is made possible by this feedback organisation: 
The automaton is provided with some performance function that, it is hoped, will 
eventually be minimised. The behaviour of the automaton is determined by the 
choice of the maps T and G, which in turn depend on the particular performance 
criterion that one is trying to minimise. The actual distributions for the response 
of the environment are xmknown and the operation of the automaton in no way 
assumes any knowledge about these responses. 

The application of this general automaton formalism to the routing of calls in 
circuit-switched networks is in the following way. Assume that in each node k of 
the network, there is an automaton, denoted for each traffic stream i, j going 
through the node. If the origin of the call is not available, the automaton is denoted 
Aj.. Two sets of actions are possible for the automaton: (1) the set of all links out of 
the node and (2) the set of all sequences of links. The environment is the network 
beyond node k, and the responses are of the reward-penalty type, corresponding 
to a connected or lost call respectively. The objective, of comse, is to minimise the 
number of lost calls. Various probability-update algorithms have been proposed 
in the literature [38,39]. For the pxxrpose of illustration of the theory of learning 
automata in the context of routing, we give below the following algorithm: 

The M-automaton suggested in [38] uses the choice of outgoing links as the 
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action set. Define gi{n) as the estimated probability of loss if action i is used at 
stage n, where action i is to route the call via group i. These state variables are 
updated by the 

g^(n + 1) = g^{n) + w[x(n + 1) - g,{n)] 


where tu is a constant and x{n) is the network response at stage n and is given by 


x{n) 


0 if the call is completed 

1 if the call is blocked. 


The action at each stage is to compute the current value of gi, rank the groups in 
decreasing order of g, and attempt to route the call in this order. 

More general algorithms, in which the update formula takes into account both 
reward and penalty (known as Lr^p schemes) have been suggested in the literature. 
An excellent introduction to this topic is given in [29]. 

The use of learning automata for routing has many advantages. The most 
obvious is the simplicity, both computationally and in terms of measurements. 
Learning automata assume nothing about the network or the traffic flows, and in 
particular do not assume that the arrival process of new calls is stationary. They are 
particularly well-suited for networks in which there are large variations in traffic. 
On the negative side are such questions as the stability of the algorithm, the rate of 
convergence, and the global optimality. Because of the difficulties associated with 
these questions, much research needs to be done before satisfactory answers can 
be given. 


2.2.6 Dynamic Flow Models 

Traffic routing and related areas of network management are currently undergoing 
review in a number of networks all over the world. The importance of reliable 
communication and the associated economic considerations account for the great 
interest in these problems in the past as well as the present. One of the main 
concerns of an efficient network management is the synthesis of an optimal routing 
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strategy. We argued in Chapter 1 that, from the perspective of s 3 mthesising control 
policies (e.g. routing strategies) in which adaptivity to network and/or traffic 
conditions can be incorporated, there is a need for a prescriptive model (as opposed 
to descriptive queueing models) of the system. We also gave a brief introduction 
to the flow model developed by Filipiak [21] in Chapter 1, and argued that the 
framework of flow model allows the network to be treated as a dynamical system 
and this, in turn, allows us to formulate the problem of optimal routing as an 
optimal control problem. We now give below a detailed description of the model 
suggested by Filipiak. 

Let A(t) represent the cumulative number of arrivals to time t,tG (0, T), D{t) 
be the cumulative number of entities serviced during time (0, t), t <T, and Q{t) 
the number of entities in the system. From the conservation principle we get the 
relationship 


Q{t) = A{t)-D{t)+Q{Q). 


( 2 . 10 ) 


Assume that the time behaviours of A{t), D(t) and Q{t) have been measured on 
several occasions and the averages A{t), D{t) and Q{t) are known. Let us assume 
that these averages are continuous functions of time, differentiable piecewise in 
(0,r). Then 


Q{t) = A(t)~D{t) + Q{0) 


( 2 . 11 ) 


dA{t) dD{t) 


dt 


dt 


Differentiating the above we get 

dQ{t) 
dt 

with the initial condition Q{0) = Qq. 

Let A*"(t) denotes the average rate of arrivals, i.e. A‘"(f) = 
x(t) denotes the average quantity in the system, i.e., x(t) = Q{t) 
and A°^‘(t) denote the average number of departures, we then get 

dx{t) 


(2.12) 


dt 


= A”"(f) - A°“‘(t) 


(2.13) 
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with the initial condition a:(0) = xq. It was assumed by Filipiak in [21], that if the 
system is not empty then the intensity of the outgoing flow can be closely 

approximated by a function G(.) of the system state x(t), i.e., 

= /iiG[x(t)] (2.14) 

where ju is the server capacity defined as the number of entities which can be served 
per unit time. Thus we find that evolution of the mean number in the system can 
be approximated by the following nonlinear differential equation 

^ = -,iG[i(i)l + A'“(i) (2.15) 

with the initial condition 3:(0) = xq. 

The following interpretation was suggested in [21] for the function G(.). For 
a constant input traffic A(f) = Ao, the system will asymptotically approach the 
steady-state x given by 


x(t) =0 = —fj,G{x) + Ao 


(2.16) 


Thus G{x) is equal to po and consequently if the description given by Equation 
(2.15) is to be accurate for the steady-state, (?(.) must represent the steady-state 
utilisation factor as a function of the mean steady-state number ki the system. 

An alternative interpretation provided by Filipiak and several other authors 
[32,33] for the function (?(.) is that pG{x) is a good approximation for the function 
(1 — Poit)) where Fo(^) is the probability that the system is empty at time t. This 
can best be illustrated by considering an M/M/1 queueing system, in which the 
service times have an exponential distribution with constant parameter p — 1 and 
the input traffic is governed by a nonhomogeneous Poisson process with intensity 
X{t). The birth-death equations for this case can be written as 


dPojt) 

dt 

dPnit) 


-X{t)Po{t) + P^{t) 

X{t)Pn-lit) - {X{t) + l)P„(f) + Pn+l{t) 


(2.17) 


dt 


(2.18) 
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Multiplying both sides of Equation (2.18) by n and summing from n = 1 to n = oo, 

CXO 

and making use of the fact that ^ nPn{t) is the average number in the system (i.e. 

n=0 

x{t) ), we get 


i = + (2.19) 

Comparing the Equation (2.19) above with Equation (2.15), it can be seen that pG{.) 
represents the probability that the system is not empty at time t for an M/M/1 
queueing system. 

The first interpretation for the function G(.) allows us to specify its functional 
form in the following marmer. In the steady-state, we have the relation G{x) = 
Let us assume that the stationary averages can be obtained from measure- 
ments, when the system is subject to load n = If the quality of 

the model is reflected in the smallness of the mean squared error, then to reduce 

N 

the steady-state errors, we must minimise the expression ^(C(zn) — pT)^- It is 

n=l 

often convenient to choose a polynomial form for G{.) and using the Gaussian 
techiuque, the polynomial coefficients which minimise the mean squared error can 
be obtained. 

To summarise the above discussion, we see that flow models describe the time 
dependent average quantities of the network by means of deterministic ordinary 
differential equations. No assumption regarding the statistical properties of the 
input traffic is made in this formulation and hence the model can incorporate 
non-stationary traffic and network conditions. 

2.3 Routing Strategies 

We have so far considered some modelling schemes by which the performance of a 
network can be studied. Performance of a network depends on such factors as the 
network configuration, the offered load, and the network management methods. 
An important element of network management, called network routing consists of 
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the decision rules used to connect the calls as they arrive at the network; a variety 
of methods are now possible. The purpose of this section is to survey the rout- 
ing techniques (also termed as algorithms /strategies) which have been suggested 
in the literature and to introduce classifications of the different schemes. These 
classifications often depend on the context in which the algorithm is studied. A 
complete classification of all the algorithms that have hitherto been proposed^ is 
beyond the scope of this thesis. Moreover, there is no consensus on the precise 
meaning of many of the terms used to characterise routing. Therefore our ap- 
proach below is to highlight some of the frequently used classifications (along with 
examples, wherever possible) that have been suggested in the literature. We look 
at them in two subsections, namely routing strategies for data networks and those 
for circuit-switched networks. 

2.3.1 Routing Strategies in Data Networks 

There are a number of ways to classify routing algorithms. A frequently used 
classification [40] is as follows: 

(i) Deterministic Algorithms 

(ii) Stochastic Algorithms 

(i) Deterministic Algorithms 

Algorithms in this class do not adapt to changes in traffic, but may be designed to 
provide satisfactory performance, on the average, over a range of traffic intensities. 
An example for this class is the least-time delay algorithm, wherein the routes for 
any source-destination pair are chosen to minimise the overall average time delay. 
Shortest -path algorithms can also be considered to be belonging to this category. In 
shortest path algorithms, each communication link is assigned a positive number 
called its length. Each path (i.e. sequence of links) between two nodes has a length 
equal to the sum of the lengths of its links. A shortest path routing algorithm routes 
each packet along a minimum length between the origin and destination nodes of 
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the packet. Much work has been done on this [49] and more sophisticated versions, 
wherein the length of each link changes with respect to time and depends upon the 
prevailing congestion level of the link, have also been studied by various authors 
[49]. 

Another class of deterministic algorithms which is frequently referred to in the 
literature on routing is the flooding algorithms. In this type of routing, each node 
receiving the message simply retransmits it over all outgoing links, or a selected 
number of these following a simple rule. To limit the number of packet transmis- 
sion, two rules are observed. First a node will not relay the packet back to the node 
from which the packet was obtained. Second, a node will transmit the packet to 
its neighbours at most once; this can be ensured by including on the packet the ID 
number of the origin node and a sequence number, which is incremented with each 
new packet issued by the origin node. By storing the highest sequence number 
received for each origin node, and by not relaying packets with sequence numbers 
that are less than or equal to the one stored, a node can avoid transmitting the same 
packet more than once on each of its incident links. This routing strategy is usually 
very simple and robust, but the network becomes flooded with multiple copies of 
any message. Therefore, this is appropriate under low traffic conditions only. 

(ii) Random (Stochastic) Algorithms. 

The simplest type of random routing strategy involves assigning fixed decision rules 
as to which neighbouring node to send the messages. The decision rule specifies the 
probability with which the messages at each node will be directed to the adjacent 
nodes. Algorithms of this type have been analysed by Kleinrock [14] and Proser 
[42]. These are simple from the implementation point of view, tend to be robust 
and are relatively insensitive to changes in network structure. However, they do 
not make use of any available information on the traffic patterns, desirability of 
certain routes, etc. 

Another classification for routing algorithms is in terms of the adaptivity to 
the traffic and/or the network conditions. Accordingly routing algorithms are 
classified into the following three categories. 
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• Static Routing Algorithms 

• Quasistatic Routing Algorithms 

• Dynamic Routing Algorithms 

In static algorithms, given fractions of the traffic (or given probabilities of routing) 
at node i of the network destined for each of the other nodes j # i, are directed on 
each of the outgoing links from node i. These fractions (probabilities) are decided 
upon before the network starts operation, are fixed in time and depend only on the 
time and ensemble averages of the message flow requirement. 

In the case of quasistatic routing, the changes in these fractions (or probabilities) 
take place at given intervals of time and/ or whenever extreme conditions (eg. link 
failure) occur. The time intervals between these changes will be long which ensures 
that messages are delivered in order and will not need individual addressing. 

Dynamic routing allows continuous changes in routes depending upon the in- 
stantaneous system states and traffic conditions. 

A further classification of dynamic routing algorithms is as follows: 

• Time dependent routing algorithms 

• State dependent routing algorithms 

State dependent algorithms are also called adaptive algorithms. 

Some authors [29] make a distinction between dynamic routing and adaptive rout- 
ing in the following way. A dynamic routing is one wherein a part of the routing 
varies over time, while an adaptive routing is one where some part of the routing is a 
function of some estimate of the network state at the time a decision must be made. 
As per this classification, a dynamic routing is not necessarily adaptive; however 
the converse is unlikely. Implicit in the notion of adaptive routing is the notion of 
measurement of the network state, which is not required for purely dynamic routing. 

Another frequently used classification based on the location in the network 
where the routing computation takes place is as follows: 
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• Centralised Routing Algorithms 

• Distributed Routing Algorithms 

In centralised algorithms, aU route choices are made at a central node, while in dis- 
tributed algorithms the computation of routes is shared among the network nodes 
with information exchanged between them as necessary. Note that this classifica- 
tion relates mostly to the implementation of the algorithm. 

A routing algorithm can be viewed as the network layer protocol that guides 
packets through the communication subnet to their correct destination. Depending 
on how this protocol is implemented, the following classification can be made: 

• Datagram 

• Virtual Circuit 

In a datagram network, two successive packets of the same user pair may travel 
along different routes, and a routing decision is necessary for each individual 
packet. In a virtual circuit network, a routing decision is made when each virtual 
circuit is set up. The routing algorithm is used to choose the communication path 
for the virtual circuit. All packets of the virtual circuit subsequently use this path up 
to the time that the virtual circuit is either terminated or rerouted for some reason. 

2.3.2 Routing Strategies in Circuit-Switched Networks 

Circuit-switched telecommunication has evolved from plain old telephony towards 
integrated digital networks. This evolution has roused increased customer de- 
mand combined with higher quality-of-service requirements. Network manage- 
ment strategies, specifically routing strategies, have imdergone drastic changes due 
to this in the last decade. In this subsection, we present a survey of the evolution 
of routing strategies in the context of circuit-switched networks. 

Automatic routing, in its simplest form, has existed since the introduction of the 
first step-by-step exchange. The digits dialed by the subscriber were transmitted 
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directly into outgoing trunk selections. Each exchange stripped off one or more 
digits and the connection was progressively established to the called party's line. 
However, this form of routing, referred to as direct routing in Figure 2.2, made 
inefficient use of transmission facilities and was found to be impractical for toll 
calls where a significant number of exchanges may need to be traversed. 

With the introduction of common control crossbar switching machines in the 
1940s, the possibility for an exchange to choose a route based on trunk group 
loading status also emerged. With this, the first forms of alternate routing were 
introduced. The simplest form of alternate routing that was suggested made use of 
tandem exchanges in metropolitan networks. Each exchange would have a number 
of direct trunks to each other exchanges and would also have overflow trunks to 
the tandem. The tandem would cormect to every exchange serving subscribers. 
This arrangement enabled significant trunking efficiencies to be achieved. 

The alternate routing concept based on the overflow technique, still had tech- 
nological limitations that required the guarantee of integrity between numbering, 
signaling, and routing. A serious issue was the phenomenon of call looping, 
wherein a call returns to one of the switching centers along its routing path. The 
existence of multiple route choices in alternate routing gave rise to this possibil- 
ity and thus the selection of compatible sets of alternatives was important. To 
overcome this difficulty, the concept of hierarchical routing was introduced in the 
1950s, where the selection of alternative paths were subject to hierarchical rules. 
Due to the limited measurement capabilities in the switches and lack of computing 
facilities, routing (the hierarchical rules for the alternatives) was determined at the 
design stage and remained fixed under normal conditions imtil the next design 
stage. Fixed hierarchical routing was thus established in the 50s and is still used 
worldwide. 

The introduction of hierarchical routing based on fixed alternatives led to signifi- 
cant gains in toll network efficiency. However, there were the following limitations 
to the efficiency gains achievable [15,43]: 

• As traffic routing is closely related to the network design in fixed hierarchical 
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Figure 2.2: Relationship of Routing Methods in Circuit Switched Networks 

networks, using a single routing pattern, determined according to busy-hour, 
busy-season traffic measurements, cannot allow the efficient accommodation 
of traffic in all situations. Analysis of the performance in. fixed routed net- 
works shows that there is some inconsistency between network capacity and 
the traffic demand, which leads to a poor grade of service in some parts of 
the network and unfairness between traffic streams. In many cases, there is 
an inefficient overprovision of the network. 

• Network robustness is not ensured, also because of the hierarchical feature of 
routing. Little adaptivity in the overflow sequence makes it difficult to cope 
with situations other than nominal. Often, parts of the network with available 
capacity can not be used when other parts experience congestion. To address 
this problem, a range of network management controls were provided within 
the exchanges (e.g. re-routing within the hierarchy, set code blocks to stop 
traffic from entering the network for a particular destination, set trunk reser- 
vation levels in order to reserve a certain number of trunks for direct traffic 
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only). These were, in general, manually activated by the telephone company 
staff once they become aware of an overload situation. Inevitably, there will 
be time delays while these are being manually implemented, causing some 
loss of traffic. 

New routing techniques referred to as dynamic routing were proposed in the 1980s 
in order to improve the network efficiency and to overcome the difficulties of the 
hierarchical routing mentioned above. The principle of dynamic routing is to profit 
from the existence of spare capacities in parts of the network while other parts 
are overloaded in order to maximise the use of network resources. The various 
methods proposed for dynamic routing may be classified against the following three 
parameters: 

1. The basic mechanism used in the method: 

la. Time dependent schemes, which take advantage of non-coincident busy 
periods across the network, on a pre-planned basis, but have limited 
ability to accommodate unplanned traffic fluctuations. 

lb. Network state dependent schemes, which sense the congestion patterns 
in the network and route traffic accordingly. They are also termed as 
adaptive routing strategies in the literature. 

2. The topological scope of the routing calculations. The methods may be 
broadly grouped into three categories based on how large a portion of the 
network is taken into accoxmt in performing routing calculations: 

2a. Centralised Routing algorithms make network-wide routing calculations. 

2b. Distributed Routing algorithms perform calculations relating to a limited 
section of the network. 

2c. Isolated Routing algorithms consider only the state of the individual ex- 
change (processor loading, tnmk group status, etc.) and the patterns of 
recently received calls. 
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3. The frequency with which the routing recommendations are updated: 

3a. Hours. 

3b. Minutes or less. 

3c. On a per call basis. 

The various routing strategies and their relationships is shown in Figure 2.2. 
Presently; dynamic routing is implemented in various networks such as the metro- 
politan [44], regional [45], long distance [46] and international [47] networks. Some 
of the major technological growths which will have impact upon dynamic routing 
can be stated as the following: 

• The introduction of Fibre optic transmission systems as a transmission media 
may cause significant changes in the philosophy of network design. The 
almost unlimited capacity could be used to improve the network resiliency 
by providing a high level of redimdancy. The implementation of the various 
functions of the dynamic routing like the transmission of the information re- 
garding the network states to the network control center(s) (where the routing 
computation takes place) is expected to be significantly much faster. 

• The current limitations placed upon dynamic routing methods lie primarily 
within the amoxmt of data which must be processed to perform complex 
call routing on a network basis. This constraint will be reduced with the 
continuing improvements in computer technology. 

Thus, to summarise the above discussion, we see that there is a shift in trend 
towards the implementation of dynamic routing algorithms in the context of circuit- 
switched networks also. 

2.4 Flow Models in the Context of Routing 

As mentioned in Chapter 1, the work on flow models was motivated by the need 
to have a modeUing scheme that can conveniently be used for control synthesis. 
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From the discussion in the Subsection 2.2.6, we note that, a basic feature of the 
flow models is that they describe the time dependent average quantities of the 
network by means of deterministic ordinary differential equations. Note that the 
model assumes no stochastic properties of the input traffic and thus is equally 
applicable to both stationary and non-stationary traffic conditions. Based on the 
work of Filip iak m [21], we now examine how the model provides a control oriented 
network description. 

Remark 2.5.1 In the discussion that follows we assume that packets are never 
rejected from any link. 

Let N = {i,j\ k , be the set of all nodes of a network, and letL = {{i.j), {j, k ), ....} 
denote the set of all unidirectional links (without loss of generality, a bidirectional 
link can be viewed as being constituted of two unidirectional links each possibly 
carrying traffic in opposite directions.) Let us define the set 0{j) as the set of all 
links of the network leaving node j and I (j) as the set of all links entering node j. 
In other words. 


OU) = : {j,k) e L} 

Hj) = {(hi) : (*,i) e L}. 


Let Xj{t) denote the traffic entering the node j from outside the network. The 
traffic arriving at node j from aU the links entering it, is given as ^ fiijGij{xij). 

Therefore the total traffic arriving at node j is given as 


Af-'Ci) = A,(t) + •£ 

Let Q!jfc(f) denote the fraction of the total traffic arriving at node j that is routed 
onto link (i, k) at time t. Then the Equation (2.15) for the link (j, k) of the network 
can be written as 


= -fijkGjk(xjkit)) + Qjk(t)Xf^°'\t) ( 2 . 20 ) 

= —jJ'jkGjkixjk) + Q-jk{t){Xj{t) + ^ Mij^ij{xtj)), V(i, it) G L. (2.21) 

*e/0) 
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Let X (t) denote the state of the network, i.e., 

]L= Xjk{t) 

where Xjk{t) {y{j,k) e L) denotes the average number of packets in the buffer 
associated with link {jk) at time t. Let a{t) denote the vector of routing variables, 
i.e. 

and let A(t) denote the vector of input traffic to the network, i.e. 

Xi{t) 

X2(t) 

Xn(i) 

Xj (t) is the external traffic arriving at node j (\ 
rearranged to get the following form: 

where the vector function / is given as 

L ~ fjk 

for all (j, k) € L. By comparing with Equation (2.21) it can be easily concluded that 
the scalar function fjk (i, a, A) is given as 

/;fc(Xn,A) = -fXjkGjkixjk) + ajkit)(Xj(t) + ( 2 - 23 ) 

t€/{j) 
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The fraction of the traffic (at any node) that is routed onto an outgoing link is 
a real number in the interval [0, 1]. At any node in the network, since there is 
no accumulation of traffic, the sum of these fractions for all the outgoing links is 
unity. Therefore the routing variables ajk(t) in the above equation must satisfy the 
following normalising conditions: 

0 < < 1. 

= 1/ V(i, k) e L. 

keo{j) 

Observe that the description of the network given by Equation (2.22) 

1) is applicable to networks of any topology and dimension. 

2) makes no assumptions on the stochastic properties for the traffic vector X{t). 
Therefore this description is applicable to both stationary and non-stationary 
traffic conditions. 

3) allows the vector of routing variables a{t) to be viewed as a control vector. 
Thus the problem of routing is amenable to control-theoretic formulation. 

For any given input traffic, the choice of the vector of routing variables n(f), de- 
termines the dynamical evolution of the state of the network (i.e. the mean buffer 
occupancies corresponding to each link). Consider an optimal routing strategy 
which minimises the total buffer occupancy time J defined as 

= r E ^ok{t)dt (2.24) 

where T is the total duration of operation of the network- The problem of synthesis- 
ing such an optimal routing strategy for the network can be stated mathematically 
as follows: 

For the dynamical system given hy Equation (2.22), with given initial conditions A(0) = 
Ap , and known input vector X{t), find the control vector (of routing variables) a{t) whose 
components satisfy the normalising conditions, such that the performance functional J 
given hy the Equation (2.24) is minimised. 
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Thus we note that the possibility of describing the network as a dynamical 
system (with the routing variables as control variables) in the framework of flow 
models allows us to formulate the problem of optimal routing in a network as 
an optimal control problem. This formulation is applicable to networks of any 
topology and dimension and is equally applicable to both stationary and non- 
stationary traffic conditions. Using a familiar technique of optimal control theory, 
namely Pontryagin's Maximum Principle, the necessary conditions that the optimal 
solution to this problem has to satisfy can be obtained. In the chapters that follow, 
we apply this technique to the two node network, three node network and larger 
networks that we mentioned in Chapter 1. 



Chapter 3 

Optimal and Suboptimal Routing 
Strategies for a Two Node Network 

3.1 Introduction 

In the previous chapter, we reviewed the framework of dynamic flow models 

within which the problem of optimal routing was formulated as an optimal control 

problem. Our emphasis in Chapter 2 was on the work done by Filipiak [21]. 

In [21] the output flow intensity from each link of a network is assumed to be 

governed by an empirically determined^ non-linear function of the average number 

of packets/ customers in the buffer associated with it. In a packet switching context, 

as the flow on a link can not exceed the channel capacity, it is reasonable to assume 

that this function saturates at the capacity value. It is also reasonable as in [21], 

to assume that the flow out from a buffer will be zero when it is empty and will 

increase with increasing buffer occupancy. Based on these considerations, we 

assume in this chapter and in the subsequent chapters, that the flow out function 

depends linearly on the average number of packets in the buffer and has an upper 

bound equal to the channel capacity of the link. We also assume that the buffers 

^In some specific cases such as an M/M/1 queue, it is possible to obtain this function from 
queueing theoretic considerations. However in majority of the cases, this function has to be 
determined from measurements. 
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are of infinite capacity and therefore packets are never rejected from any link. 

The network topology which we consider in this chapter is a simple one of two 
nodes as shown in Figure 3.1. Packets arriving at node 1 are to be routed to the 
destination node 2 through one of the two available paths, namely link 1 and link 
2. In the analysis that follows, we assume that link 1 has a finite channel capacity 
equal to Ci and link 2 has infinite charmel capacity. 

Leta:i(t) and 2:2 (t) denote the number of packets at timet, in the buffers associated 
with links 1 and 2 respectively. Let ai(t) be the fraction of traffic (of the total traffic 
X{t) arriving at node 1) routed on link 1 at time t, and 02 (t) be that on link 2. Then, 
from flow conservation principle and from the assumption regarding the nature 
of the flow out functions, it follows that the dynamic evolution of the state of the 
network is given by the following differential equations: 

iiii) = -/i(a:i) +Q;i(t)A(t) (3.1) 

xiit) = — 02 X 2 + o:2{t)X{t) (3.2) 


where the function is specified as follows: 




aiXi if xi < xis — Cxjai 
Cl otherwise 


(3.3) 


3.2 Problem Formulation 

The problem of synthesizing the optimal routing strategy is formulated as follows: 


ai, Cl 



Figure 3.1: Network Topology of two nodes 
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Given the network parameters ci, az and Ci, and the traffic pattern X{t) during 
the interval of operation [0, T] for the system whose dynamics is given by (3.1) 
and (3.2), find the routing variables ci;i(f) and azit) (Vi € [0,T])/ which satisfy the 
normalizing conditions: 


0<ni(i)<l, (3.4) 

0 < azit) < 1, (3.5) 

ai{t) + azit) = 1, Vie[0,r] (3.6) 

so as to minimise the performance index 

J = r + xzit))dt (3.7) 

Jo 


The above performance index J is the total buffer occupancy time and the rationale 
for minimizing this is that a waiting cost is incurred at a rate proportional to the 
number of customers present m the system. 

3.3 Solution Approach 

Assumption 3.3.1 In the analysis that follows, we assume that the initial buffer 
occupancies of the network do not exceed the saturation values, i.e. xi ( 0 ) < xu 
and 0 : 2 ( 0 ) is finite. 

Remark 3.3.1 The assumption that the initial buffer occupancy xi(0) does not 
exceed the saturation value zis may appear to be overly restrictive, but is not quite 
so in practice as can be argued on the following grounds. Consider the network to 
be operated for finite intervals [0,Ti], [ 72 , T 3 ], [T 4 ,r 5 ] ...., (the network is assumed 
to be shut down dtxring (fy, Tz), (T 3 , T4),....) which is the situation considered for 
investigation in this thesis. We shall soon prove that, the optimal routing strategy 
or the suboptimal routing strategy which we propose in Section 3.5 of this chapter 
has the following interesting property. If at the beginning of an interval of network 
operation say [T„Tj], xi(Ti) < xis, then under the optimal/ suboptimal routing 
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strategy, xi{Tj) < xu. Since it is reasonable to assume that at the very beginning 
of the network operation, the buffer occupancies are zero, and furthermore dining 
the intervals of shutdown, the buffer occupancies can not increase (since no traffic 
is admitted into the network), the assumption that at the beginning of any interval 
of operation, the buffer occupancy of link 1 does not exceed the saturation value 
xis, is not restrictive in practical terms. 

To solve the above optimal control problem, we use the maximum principle 
by Pontryagin [22,23]. The function is discontinuous at xi ~ xu- For the 
maximum principle to be applicable it is necessary that be continuous in xi- 
We therefore consider a class of optimal control problems in which the dynamics 
of link 1 is modified as 

it = -/i (^i) + Oii{t)X{t) (3.8) 


The function /[ (xi) (shown in Figure 3.2) is defined as below: 

aiXi 


ifxi + 


= 


- (xi - Xs)^ + Cl - r Xi < xi < Xs 
Cl if 2:1 > Xs 


where, a;* = and r > 0. 

' * ai ai 


dfi(xi) 

dxi 


ai 


iSxi < xi 


0 if xi > Xs 


(3.9) 


(3.10) 


Notes: 


1. The function fi(xi) is obtained by drawing an arc of radius r, tangential to 
the lines /i(xi) = aiXi and /i(a:i) = Ci, as shown in Figure 3.2. The centre of 
this arc is at (xj, C\ — r). 

2. Asr , fi{xi) -> /i(a:i), Vji >0; xi-y Xu, Xs Xu. 

3. From Equation (3.10), it can easily be verified that ^ is a monotonically 
decreasing function in the interval [zu x*]. 
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Figure 3.2: Modified How out function 

4. The dynamics of link 2, the normalizing conditions on ai{t) and azit) and 
the performance index J are the same as that of the original formulation. 
The earlier Assumption 3.3.1 that the initial buffer occupancy xi (0) < is 
modified as, xj(0) < xi. 

For the above class of problems, we investigate the nature of the optimal routing 
strategy. Let and x^it) be the optimal state variables, pl{t) and P 2 {t) be 
the optimal costate variables and a[(t) and oc 2 {t) be the optimal control variables 
corresponding to a choice r. The Hamiltonian is given as: 

a’’) = xl{t) + - Pifiix^) + p[alX{t) - +plalX{t). 

Minimizing FT’" w.r.t. Q;i(t) and 3 tields the following optimal control policy: 

• liplit) is less thanp 2 ( 0 / equals unity and equals zero. 

• If Pi(i) is greater thanp 2 (^)/ then al{t) equals zero and a 2 (f) equals unity. 

• If for all t in some interval I, p\ {t) and p^it) are identically the same, then ct\ (t) 
is not specified by the above conditions. 

According to the maximum principle, the optimal costate variables p[{t) and p^it) 
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must satisfy the following differential equations: 


PI = -dH^/dxl 

dfl 


PI = 


-dH^Jdxl 
-1 + azp^it) 


(3.11) 

(3.12) 


along with the transversality conditions pl{T) = pliT) = 0. 
The solution for ^^(f) is given as 


pl{t) = 


1 




az 


(3.13) 


Remark 3.3.2 If ai is less than az, then it can be argued that a{ {t) equals zero and 
a^it) equal unity, Vf e [0, T] is the optimal routing strategy. This follows from the 
fact that 


m = 0=^^ > Pi{t) = V( e [0, T). 

Remark 3.3.3 If ai equals az, then it can be argued that any routing strategy which 
ensures that xl{t) never exceeds x/ [ in the limiting case as r tends to zero, 
achieves optimality. 

In what follows, we therefore focus our attention to the case wherein Ui > az- 
Let Xtr be the value of x^ at which ^ equals az. Then xi < Xtr < Xg and as r tends 
to zero, xtT tends to xig. 

Before proceeding to investigate the nature of the optimal routing strategy for 
this class of models, and discuss the implementation details, we first define below 
some of the terms which are frequently used in the remaining part of this chapter. 

Definition 3.3.1 If for all t in some interval I, x\{t) < xi then the network is said 
to be operating in the linear mode during I, and such an interval I is termed as a 
linear regime. 
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Definition 3.3.2 If for all tml, x\{t) > Xs then the network is said to be operating 
in the saturation mode during I and such an interval I is termed as a saturation 
regime. 

Definition 3.3.3 If for all i'm I, xi < Xi{t) < Xs then the network is said to be 
operating in the transition mode during / and such an interval I is termed as a 
transition regime. 

For the model corresponding to the limiting case in which r tends to zero, the above 
terms are defined as follows: 

Definition 3.3.4 If for all t in I, xi{t) < x^, then I is termed as a linear regime and 
the network is said to be operating in the linear mode during I. 

Definition 3.3.5 If for all tin I, xi (t) = xu, then I is termed as a transition regime 
and the network is said to be operating in the transition mode during I. 

Definition 3.3.6 If for all t in /, a:i (t) > xu, then I is termed as a saturation regime 
and the network is said to be operating in the saturation mode during /. 

Lemma 3.3.1 If 'it 6 I, p\{t) = P 2 {^), then OL\{t) = during I. 

Proof : 


FiW 

= Piit) 

£[(f£) 

dxl 

= Piii) 

= 02 

x[(t) 

= Xtr and 

xl{t) 

= 0 it el. 

Therefore af {t) — 

Vf G /. In the limiting case as r tends to zero, al(t) = 


□ 

Definition 3.3.7 

An interval during which ai(t) equals is termed as an 


interval of partial routing. 

Lemma 3.3.2 The functions Pi(t) andpt^f) are non-negative in the interval [0, T]. 
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Proof : It is easy to verify that the function which is equal to is 

non-negative over [0, T]. 

^fT 

fi = + rf(i’) = o. 

Solving the above, 


KW = K(0) 


„ ££(£( 7 )) .t IfMlDldr 


where Pi(0) = / e ‘'"'i > e ‘'“’I '^dr fotO <t <T. 

Jo Jo 


Since pl(t) is the product of two positive terms, it is positive Vt e [0, T). Hence the 
lemma. 


□ 

Towards finding the nature of the optimal routing strategy, we prove the following 
theorems. 


Theorem 3.3.1 The system can not end in : 

(a) a saturation regime 

(b) a transition regime wherein 'it, x\{t) > Xtr- 

Proof : In either of the above two cases, x\{t) > Xtr- Let Ii = [ti, T] be an interval 
during which xl{t) > Xtr- Then ^ < ^2 over the entire interval /i. Therefore, 
p\ < -1 azPi (since by Lemma 3.3.2, pl{t) > 0, it e [0, T]) while P 2 = —1 + in 
li- 
lt can then be argued^ that, p{{t) > p^it) in [?Ji, T). Consequently al(t) = 0 in /i. 
The dynamics of in Ii is given as: 

= ~fiK)- 

Therefore arj (t) is a monotonically decreasing function of time in Ii, and at f = ti, 

= r nix[iT))dr + x{{T) 

Jtl 

> (T - ti)fl{xtr) + Xtr (as per the assumption that xj(r) > Xtr, Vr e h.) 
^We do not go into these arguments for reasons of brevity. 

LiBRAm 

^ KANPUR 
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From the above property of x\ (t) (that this function is monotonically decreasing in 
Ii and everywhere greater than Xtr) and the from the fact^ that x^ (t) is a continuous 
function in the entire interval [0, TJ, it follows that A is preceded by an interval in 
which Xi(t) > Xtr- Let us denote this interval by Iq where Iq = [to, h] (for some 
to < ti). Then the arguments which were used to prove that Xi(t) is monotonic 
and decreasing in Ji can now be extended to the interval loUh = [^o, T] and it 
can be argued that Iq, in turn, is preceded by an interval during which x\ (t) > Xtr- 
Extending these arguments, it can be concluded that x\(t) > Xtr, Vt G [0, T], and 
in particular a:i(0) > Xtr + Jq fl{x\(T))dT. Since this violates the assumption that 
the initial buffer occupancy x\ (0) < xi, the terminating regime can not be one in 
which, for all t, x\(t) > Xtr- 

□ 

In the case of the model in which r tends to zero, if the network operation starts 
in the linear mode, then the buffer occupancy of link 1 (i.e. xi{t)) never exceeds a 
value equal to xu + Ci{T — t). This value is thus an upper boimd (not necessarily 
tight) on xi(t) provided the routing strategy is optimal. 

Theorem 3.3.2 The value of the routing variable aKt) is either 1 or Vi G [0, T]. 
Proof : We show thatpj(i) < p 2 (t)yt G [0, T], as follows: 

Let us assume on the contrary that pl(t) > pl(t) = , for all i in some interval 

Iq = [io,ii)- Thena:j(i) = Oover/o, and Xi(i) is a monotonically decreasing function 
in/o. 

By reasonings similar to those used in the proof of Theorem 3.3.1, it can be argued 
that if there is any subinterval in Iq during which xl(t) > Xtr, then it should have 
been preceded by such an interval (wherein ^^(i) > Xtr) all the way starting at 
t = 0. Since this results in the violation of the initial condition Xj(0) < xi, it can 
be concluded that there exists no such subinterval of Iq during which x^t) > Xtv 
Consequently a:i(f) < xtr, V t G /o- 

^Implidt in this inference is the assumption that the load pattern doesn't have any impulses and 
therefore the buffer occupancies are continuous fimctions of time. 
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Hence ^ > az^t e Iq. During Iq, 

p[ > — 1 + 02^1 and 
Pz = ~1 + 02^2 

(Pi-Pi) > o,z{p\-pl) 

> 0 (as per the assumption that p\{t) > P2{t)/ Vt € Iq.) 

Thus {jp\ (t) -Pzit)) is not only positive, but also monotonically increasing in Iq, and 
hence^ Pi(^i) ~ ^ 2 (^ 1 ) ^ ^* 1 (^ 0 ) — ^ 2 (^ 0 ) > 0- This implies that Iq is followed by an 
mterval [ti, tz) in which pl{t) > Pzit). The arguments that were used to prove that 
• Pi(^) ~ Pii'^) is monotonically increasing in Iq can now be extended to Iq U Ii and 
it can be argued that Iq U A is also followed by an interval in which Pi{t) > P 2 {t). 
Extending these arguments, it can be concluded that the relationship p[{t) > p^it) 
has to hold true for all t in [fo, T]. But Pi{T) > Pz{T) violates the transversality 
condition and therefore the initial assumption of the existence of an interval Iq 
during which Pi(t) > P 2 {t) is incorrect. We have already seen that if < Pz{t)f 
then a\{t) — 1. And if for all t in some interval I, p\{t) = P2{t) then Q[{t) = , 

in I (by Lemma 3.3.1). Thus the routing variable a![(f) is either 1 or for all 
te[0,r]. 

□ 

From the Theorems 3.3.1 and 3.3.2, an interesting observation on the nature of 
the optimal routing strategy emerges. If during the network operation, the buffer 
occupancy of link 1 reaches a value equal to Xtr (in the limiting case as r tends to 
zero, the value equal to at an instant of time Iq, and if the input traffic X{t) 
to the network for the remaining interval of network operation [fo,T] is greater 
than fiixtr) {Cl in the limiting case), then the optimal routing strategy for that 
interval [to, T] is given as a[(f) = (in the limiting case ^ ). In other words, the 
remaining time span of network operation is an interval of partial routing in which 
both the links 1 and 2 are used to carry the arriving traffic A(f). 

Implicit in this inference is the fact that the costate variables are continuous functions of time. 
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During an interval of partial routing, OL\{t) equals and xl(t) is identically 

equal to Xtr- We now show that such an interval, can neither be followed by an 
interval in which x^f) is less than Xtr, nor be preceded by one in which Xi(t) is 
greater than Xtr- 

Theorem 3.3.3 An interval of partial routing can not be: 

(a) followed by a transition regime in which x{{t) is less than xtr 

(b) preceded by a transition regime in which is greater than xtr- 

Proof : Let I = [to, ti] be an interval of partial routing. During I, p\{t) is identically 
equal to plit). 

(a) Assume that I is followed by an interval f during which x^f) < Xtr- 
Then p\>—l + a 2 Pi and p^ = —I + a 2 P 2 ,'^t E f. 

This implies that (p[ — pf) > 02(^1 — ^ 

Therefore {pl{t)-plit)) > (pHti) - Vt e A. 

Hence {pl{t) - pl(t)) > 0, Vt e A. 

But it has already been proved that pKt) is upper bounded by p^it) (in the proof 
of Theorem 3.3.2) for all t in [0, T]. Thus the assumption that / is followed by an 
interval during which xl (t) < Xtr is incorrect. 

(b) If / is preceded by an interval Iq during which (t ) > Xtrr then Pi < — 1 + a 2 p\ 
and = — 1 + a 2 P 2 , Vt G Iq, which impHes that (pj - pf) < 02(^1 — pf} in h- Since 
Pi(^o)— ^2(^0) = 0 , it can be argued that pj(t) > p^ifyt € /q, which is a contradiction 
as per Theorem 3.3.2. Thus an interval of partial routing can neither be followed by 
a transition regime in which xl {t) is less than Xtr nor be preceded by a regime in 
which r![(i) is greater than Xtr- 

□ 

Comments: It can be seen that the above theorems and lemmas hold true even if 
the assumption on the initial buffer occupancy {xl (0) < xi) is relaxed to (0) < Xtr- 
In the limiting case of r tending to zero, both xi and Xtr tend to xu, and therefore, 
for the original model this relaxation is of no significance. 
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3.4 Optimal Routing Strategy: Implementation 


Theorem 3.3.2 states that either the entire input traffic is routed onto the faster link, 
or there are intervals of partial routing. Therefore the optimal routing strategy can 
be implemented in the following steps: 

I. Check if oi[{t) = 1, 'it £ [0,T] is the optimal routing strategy by the following 
steps: 


1. Integrate the equation xl — —fiix[) + X{t) with the given initial condition 

a:i(0) and obtain xl{t) and it £ [0, T]. 

2. Integrate the equation pj = — 1 + with p\iT) = 0 from i = T to ^ = 0, 

and obtain pi(t). 

3. Check if plf) < ^ it £ [0,7]. If this inequality is satisfied for all t, 

then al (t) = 1 is the optimal routing strategy. 


n. If the inequality in step 1.3 is violated for some t £ [0, T], then there are intervals 
of partial routing during which a[{t) equals (For the model in which r tends 

to zero, ai(i) equals ^). 

We now investigate a procedure to specify the duration of such intervals of partial 
routing, if they exist. We shall first investigate the case wherein the traffic pattern 
X{t) has a single positive crossing over the value /{ (xtr) (in the limiting case Ci) as 
shown in Figure 3.3 and Figure 3.4. 

In the case of a load pattern X{t) which ends with a value greater than /{ (xtr) (in 
the limiting case Ci) it has already been argued that the optimal routing strategy is 
specified as: 


a[(f) 


1 ; Vi€[0,i,] 

^ ; W€(f,.ri. 


where ts is the first instant at which a:i(i) = Xtr- 

For load patterns which end with a value less than /[ (xtr) (in the limiting case 
Cl) as shown in Figure 3.4, it can be argued from Theorems 3.3.2 and 3.3.3 that, if 
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there is an interval of partial routing then it has to start at the instant ts {ts is the first 
instant at which {t) equals xtr) For t G [0, a\ (t) =1. Let the interval of partial 
routing be [ts, ti] where ts <ti < tb. The optimal routing strategy is then given by: 


Solution for tii 


al{t) 


' 1 ; Vt G [0,ts]. 

' \'(Ty / vtG(t5,ti]. 
1 ; Vt G {ti,T]. 


1 _ fiO-iik-T) 

p'dti) = pm = ( 3 14 ) 

<22 

At t = ti, Xi(ti) equals Xtr- Let (t^ > ti) be the instant when xlf) reaches the 
value Xtr- Durmg the interval [ti, tl], xl(t) > Xtr and during T], < Xtr- 


f (Mr) - /{(M(r)))dr = iK*!) - M(t,) = 0 (3 15) 

Jtl 

In the control problem corresponding to the case where r tends to zero. Equation 
(3 15) reduces to the following: 


XMdr = Cifl - h) (3 16) 

Furthermore, for the limiting case of r tendmg to zero, the dynamics of Pi(t) over 
[tl, tj] IS given by 


P\{t) = Plih) - {t - tl) 

— g“2(^l~2’) 

= {t - tl) (after substituting the r.h s of Equation 3.14). 

<22 


At t = tl, 


Pi(^i) 


1 _ e“i(6'-2’) 

ai 




a2 


- (tl - tl) 


Solution to the Equations (3.16) and (3.17) gives the instants ti and tf 


(3 17) 
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3.4.1 Numerical Examples 


For a network with link parameters ai = 0 9 , 02 = 0 2, and C\ = 9 and initial buffer 
occupancies 2 : 1 ( 0 ) = 2 : 2 ( 0 ) = 0, operated for an interval [0, 10], the optimal routing 
strategies and the correspondmg performance mdices are obtamed for various 
choices of the traffic X{t) by the following procedure: 

Consider the performance mdex J of a routing strategy given below 


ai{t) = { 


1 

Cl 

A(t) 

1 


'it e [0, ts] 
it G {ts, tp] 

it G {tp, T] 


The variation m the performance index J as the parameter tp is varied over [tj, ti] 
IS plotted m each of the examples (shown in Figures 3.6, 3 7, 3 8 and 3.9) The 
value of tp at which the performance mdex attains the minimum is the instant ti 
correspondmg to the optimal routing strategy 

It can be seen that for the load pattern m Example 1 (Figure 3 6), the minimum 
performance mdex is obtamed at tp = ts = 0 67. 

It IS easily verified m each of the examples that the value of tp at which J is 
minimum, satisfies the Equations (3 16) and (3.17) derived m the previous section. 


3.4.2 Extension to Arbitrary Load Patterns 

Consider a load pattern \{t) which has n positive crossings above the value equal 
to C\ as shown in Figure 3 5. From the Theorems 3.3.2 and 3 3.3, it can be concluded 
that intervals of partial routing, if they exist, are of the t3q3e ,ti], > ^ 2 ] , • < tn] 
where to, < tj, < f, < U, and tsp ts 2 are the instants at which xi{t) = aii^. 


Notes: 


1 . 


In the arguments that follow, we consider the case wherem r tends to zero. 
Hence xi,Xs and Xtr tend to xu = 
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Figure 3 6- Performance vs. tp for Example 1 
The value of tp at which the performance index is minimum = 0.67. 


2. The instants .. are those for which the value of xi{t) reaches 

from a smaller value i e. Xi(f“) < xu and xi(tsj = Xi^. 


The optimal routmg strategy is specified as: 
aiit) = 


for the mterval , U], i = l,2, 3, ....n. 
1 elsewhere. 
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Figure 3 7 Performance vs. tp for Example 2 
The value of tp at which the performance mdex is minimum = 0 67. 

Let be the interval following the interval of partial routmg in which 

x-i{t) > xis and xi{U) = xi{t*) = xu, for z=l,2,...n. Then we have, 

A(r).dr = Ci{t: - f.), for ^ = 1, 2, .. n (A) 

A. 

During the interval [f*, Q!i(t) = 1 and the network operation is m the linear 
mode. Therefore the dynamics of link 1 is given by xi = —a\xi + A(t) with the 
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Figure 3 8: Performance vs. ip for Example 3 
The value of ip at which the performance index is mmimum= 0.916. 


initial condition a:i(i*) = xu- Therefore, 

e'‘^^X(T)dr , (n-1) 

Smce xi(ii,_^,) = xi^, we obtam the followmg (n-1) equations m ij/s and i^'s 


xi. 


,[1 — = e ~“* ^*‘+1 




e“'^A(r)dT 1 = 1,2, .. (n-1) 


(B) 
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Figure 3 9: Performance vs. tp for Example 4 
The value of tp at which the performance mdex is mmimum = 1.06. 


Durmg the mterval [f,, f*], xi{t) > xis, therefore pi = -1, and p\{U) = P 2 {t,) — 
Therefore 

ai 


(1 - 

a2 


= (C - U) +Pi{t*) 


(3 18) 
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Over [t% ,pi{t;) = -1 + aipi = p 2 {ts^+i)- Hence 




(1 




ai 


(3 19) 


Substituting the rh.s of the above m Equation (3 18), we obtain the following n 
equations. 

For 2 = 1,2,.. , n 


^ — . op-lipi 
02 


= « - U) +P2(is.+i)e“i^‘* + 




Oi 


(C) 


To solve for ti, z-sj, ^2, ^ ^n, tn ws ha VC to solve the 3n-l Equations (A), (B), 

and (C) given above. 


3.5 Suboptimal Algorithm 

From the discussion m the precedmg section, the followmg conclusions can be 
drawn on the synthesis of the optimal routing strategy (ORS). 

• To specify the ORS, the traffic pattern A(i) for the entire mterval [0, T], has to be 
known prior to the start of the network operation. An onlme implementation 
of the ORS is therefore not possible. 

• As the number of positive crossings of the load pattern X{t) above the value 
equal to C\ increases, the number of equations for specifymg the mter\'-als 
of partial routing mcreases by a factor 3. It is difficult to obtam analytical 
soluhons to these equations and we expect that the numerical procedures 
employed to solve them would become more computationally mtensive as n 
mcreases 

The above reasons motivate the need for a suboptimal strategy Based on the 
prachcal considerations that Imk 1 can not carry packets any faster than its channel 
capacity Ci (which is achieved when xi{t) = ii^) and once this maximum rate is 
achieved, the slower Imk (i e link 2) can be used for carrying the excess traffic 
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(than required to keep the flow on link 1 equal to C\), we propose the following 
on-line implementable suboptimal algorithm 


ai{t) 


1 ; over [0, 

^ ; over (f,,, ft.), t = 1,2, n 
1 ; elsewhere 


where fg/s are the mstants at which xi{t) reaches the value and tb/s, as shown 
m Figure 3 5, are the mstants corresponding to the negahve crossmgs of the load 
pattern X{t) with the value equal to Ci 


3.5.1 Numerical Examples 

For a network with parameters a\ = 0 9,a2 = 0 2, Ci = 9,xig = 10 ,j:i( 0) = 
0, X2(0) = 0, T = 10 units we compare the performances of the optimal and subop- 
timal (proposed above) algorithms for the following load patterns 

Case A: 


25 
20 

S 15 
o 10 
5 
0 

0123456789 10 

time t 
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Table 3 1. Optimal and Suboptunal Strategies for Case A 


Optimal Strategy 

Suboptimai Strategy 

ai{t) = 1 for t e [0, 0 6643] 

= 9/20 for t e (0 6643, 1 900] 
=1 for ^ G (1 9, 5 34] 

=9/15 for t e (5 34, 6 92] 
=lfort G (6 92. 10]. 

ai{t) = 1 for t G [0, 0 6643] 
=9/20 for t G (0 6643, 2.5] 
=lfori G (2 5,5 52] 

=9/15 for fG (5 52,7 5) 

=1 for t G [7 5, 10] 

Jopt = 183 396 

! J subopt “ 194 317 



Figure 3.10. Buffer occupancies under the optimal strategy for Case A 



Figure 3 11 Buffer occupancies under the suboptimai strategy for Case A 
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Case B: 
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Table 3 2 Optimal and Suboptimal Strategies for Case B 


J I L 


Optimal Strategy 

Suboptimal Strategy 

ai(t) = lfort € [0,10181] 

= 9/15, t€ (1 0181,1480] 
=1 fort G (1 48,5 6384] 
=9/12 for t e (5 6384. 6 93] 
=1 for t G (6 93, 10] 

ai(t) = lfort G [0,10181] 
=9/15, tG (1 0181,2 5] 
=l,t G (2 5,5 8724] 
=9/12, t G (5 8724.7 5) 
=1 for t G [7 5, 10] 

= 122 2793 

Jsubopt = 131 7026 



Figure 3 12. Buffer occupancies under the optimal strategy for Case B 
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Figure 3 13 Buffer occupancies under the suboptimal strategy for Case B 


Case C: 
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Table 3 3. Optimal and Suboptimal Strategies for Case C 


Optimal Strategy 

Suboptimal Strategy 

ai(t} = 1 for t 6 [0, 10] 

1 

Q;i(t) = 1 for t G [0, 6 6918] 
=9/10, t G (6 6918, 7 5] 
=1, t G (7 5, 10] 

= 76 89797 ^ 

4ufa.pt = 77 4746 






3 5 Suboptimal Algorithm 


68 



Figure 3 14 Buffer occupancies under the optimal strategy for Case C 



Figure 3 15‘ Buffer occupancies imder the suboptimal strategy for Case C 
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Case D: 


a 

o 



time 


4 


Table 3 4 Optimal and Suboptimal Strategies for Case D 


Optimal Strategy 

Suboptimal Strategy 

Qi{t) = Ifort G [0,5 520] 

= 9/15forf € (5 52,6 92] 
= 1 over (6 92, 10] 

ai{t) = 1 for t G [0, 5 52] 
=9/15, t G (5 52,7 5] 
=1, t G (7 5, 10] 

= 105 25624 

■J^ubopt = 106 9277 



Figure 3 16 Buffer occupancies under the optimal strategy for Case D 
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Table 3 5 Optimal and Suboptimal Strategies for Case E 


Optimal Strategy 

Suboptimal Strategy 

ai(t) = Ifort € [0,1 79] 

= 9/m,te (1 79,250] 

= 9/(50 -lot) fort G (2 5 3 21] 
=1 for t G (3 21. 6 54] 

= 9/(10t - 50) for t G (6 54. 7 5] 

= 9/(100 - lOf) for t G (7 5 8 8] 
=1 over (8 8. 10] 

ai(t) = 1 for t G [0, 1 79] 

=9/10t,t G (179,2 5] 
=9/(50-10t),fG (2 5,41] 

=l,t G (41,6 61) 

= 9/(10t-50)fortG [6 61,7 5] 
=9/(100 - lot) for (7 5,9 1] 

=1 over (9 1, 10] 

Jopt = 209 2164 

Jsubovt = 213 50038 



Figure 3 18: Buffer occupancies under the optimal strategy for Case E 



Figure 3.19: Buffer occupancies imder the suboptimal strategy for Case E 
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Finally, we make the followmg observations regardmg the nature of the optimal 
routmg strategy for the case where the network operahon starts m the saturation 
mode. If the imtial buffer occupancy ri(0) is such that a:i(0) > + C-yT, then 

ai{t) = 0 and a2{t) = 1, Vt G [0 T] is the optimal routmg strategy. This follows 
from the fact the network operates m the saturation mode for the entire duration 
[0, T] and therefore pi = — 1 , p\{T) = 0 Solution to this is pi{t) = T ~ t Smce 
T-t> p2{t) = for all t E [0, T], ai(i) = 0 

The above result is m agreement with the followmg mtuition also. Smce the 
mitial buffer occupancy xi[0) is large enough to guarantee that the Imk 1 can be 
operated at the maximum rate(Ci) for the enhre duration [0, T] even when no new 
packets are routed onto it, and smce the rate at which packets are drawn out on 
Imk 2 increases Imearly with its buffer occupancy, it is necessary to route all the 
traffic onto link 2 (for the entire duration) to mmimize the total waitmg time J 
For initial buffer occupancies xdOl such that < xi(0) < xu -F CyT, it can be 
argued (along the Imes of Theorem 3 31) that the network operahon can not end 
in saturation mode and hence ends either in the hnear mode or m the transihon 
mode It can also be argued that if .Ly{t) at any instant t = to is equal to and if 
/\(f) IS greater than Cy for all t > , then ai(t) equals is the optimal strategy 

m the interval [to, T] An exhaushve inveshgation of these cases, is however, not 
attempted m this thesis 

3.6 Conclusions 

In this chapter we investigated the problem of optimal routmg m a two node net- 
work m which the faster link has fimte channel capacity, under the assumphon that 
the buffer occupancies at the beginnmg of the network operahon do not exceed 
the saturahon values We argued that either the enhre traffic X{t) is routed onto 
the /aster Imk (i e ay equals imity m our case) or there is a parhal routing of ^ 
onto this Imk The equahons required to be solved to specify the instants at which 
the network operahon enters /comes out of, these intervals of partial routing, were 
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derived in terms of the link parameters ai. 02 and Ci and the mput traffic Mt) to 
the network A suboptimal algorithm which doesn't require the knowledge of the 
traffic pattern \{t) for the entire duration [0. T], and, hence can be implemented 
on an on-lme basis, was proposed and its performance compared with the optimal 
algorithm, m the case of some specific load patterns. 



Chapter 4 


Optimal and Suboptimal Routing 
Strategies for a Three Node Network 

4.1 Introduction 

In Chapter 1, we stated the motivations for the synthesis of optimal/suboptimal 
routing strategies for a large network from those for appropnately chosen, simpler 
network units which constitute it With this perspective m the background, we 
investigated the problem of optimal traffic routing m a two-node network m the 
previous chapter. Under the assumptions that the faster imk of this unit has a fmite 
channel capacity and that the mitial buffer occupancy for this Imk does not exceed 
its saturation value, we derived a set of equations (in terms of the link parameters of 
the network and the input traffic X{t)) that are to be solved for specifymg the optimal 
routing strategy A suboptimal algorithm was also proposed for this network and 
its performance was compared with the optimal one m the case of some specific 
load patterns. 

In this chapter, we mvestigate the problem of optimal routmg m a basic network 
unit of three nodes shown m Figure 4.1. Nodes 1 and 2 of this network are source 
nodes which receive packets from the outside and node 3 is the destmabon node A 
direct path and an altemate(indirect) path are provided at each source node Lmk (1,3) 
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IS the direct path at node I, while the set of links { (1,2),(2,3) } constitute the alternate 
path Similarly link (2,3) is the direct path at node 2, while the alternate path is 
constituted of the set of Imks {(2,1), (1,3)} At the source nodes 1 and 2, dedicated 
buffers are assumed to be provided for each of their outgomg links Furthermore, 
we assume that the flowout on any link depends Imearly on the buffer occupancy 
and has an upper boimd equal to the channel capacity of that link 

We first formulate the problem of optimal routmg for this network umt m Section 
4 2 of this chapter The properties and the implementation details of the optimal 
routmg strategy for the case wherem all the links of the network have mfmite 
channel capacities are discussed in Section 4 3 This corresponds to the linear mode 
of operation (of all the Imks) of the network It is shown that the optimal routmg 
strategy depends only on the Imk parameters of the network and is mdependent 
of the mput traffic Xi{t) and Xiit) The optimal routmg strategy is also shown to 
have the loop-free property 

We then relax the above assumption (of mfmite charmel capacities for all the 
links) m Section 4 4 and investigate the case wherem one of the direct imks ( link 
(1,3) m this analysis) of the network is of finite charmel capacity We show that 
the routmg strategy at the source node 1 need not be bang-bang (in Section 4 5 we 
give examples wherem the routmg variable ai 3 (f) takes non-zero, non-unity values 
during intervals of network operation) We prove that the optimal routmg strategy 
has the loop-free property m this case also Of the 27 possible modes of network 



Figure 4 1. Network Topology of three nodes 
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operation (which are defined in Subsection 4 4 3) only 4 are possible in a terminal 
interval Numerical examples are cited to illustrate these cases. 

In Section 4 5, we consider the case of networks with a direct link of hnite channel 
capacity with certam (stated) assumptions on the Link parameters au, 0 . 13 , aii and 
023 and on the mihal buffer occupancies The implication of these assumptions 
(regarding the link parameters) is that, if all the links were of infinite capacity, 
then the ophmal routing strategy would be direct routing for the entire duration 
of network operation. For the case wherem the mitial buffer occupancy on the 
Imk with fmite channel capacity is below the saturation value, we derive a set 
of equations (m terms of the Imk parameters and the mput traffic), the solution 
to which specify the optimal routing strategy A suboptimal algorithm is also 
proposed and its performance is compared with the optimal one m the case of 
some illustrative examples 

In Section 4 6, we consider the case wherem the flowout on a Imk is an exponen- 
tial function of the (associated) buffer occupancy For small values of the buffer 
occupancy this model approximates the Imear model, while for large values of 
the buffer occupancy the flowout reaches a saturation value equal to the channel 
capacity of that link The optimal routing strateg}^ for this model is obtamed by 
numerically solving the two point boundary value problem m the state and costate 
variables From the numerical investigations carried out for various choice of the 
Imk parameters, initial buffer occupancies and mput traffic, we conjecture that the 
optimal routing strategy has the loop-free property m this case also. It is also 
observed that the network operation ends with a direct routing (at both the source 
nodes) of the mput traffic under the optimal routmg strategy. The state variables 
(buffer occupancies) and the costate variables imder the optimal routmg strategy 
are obtamed numerically and they are shown m the form of graphs 

Fmally m Section 4 7, we recapitulate the major results m this chapter 
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4.2 Flow Model and the Problem Formulation 


From the flow conservation prmciple and our assumed utilisation of link (j,k) m 
either the linear mode or the saturation mode, it is easily argued that the average 
number of packets Xjk, m the buffer associated with Imk (],k) is governed by the 
equation 


-ajkXjk + X'-Jkit) lix^k < Cjk/a^k ••••(a) 
+ otherwise .... (b) 


In the above, 4.1(a) corresponds to the linear mode of operation and 4 1(b) corre- 
sponds to the saturation mode of operation of hnk (],k), is the rate of mput 
traffic flow to the Imk (j,k), Cji is the channel capacity of the Imk (],k) and the Imk 
parameter ajk determmes the rate at which packets are drawn out onto the Imk 
from the buffer. 

It then follows that the dynamical evolution of the state of the network shown 
m Figure 4.1, when all its Imks operate m the linear mode, is given by 



—cijii'niO + Q;i2(i)['^i(i) + ct2ir^2i(i)] 

(4.2) 

•1'’13(0 = 

—ai3a 13(f) -t- ai3(f)[Ai(f) -1- a2iX2i(f)] 

(4 3) 

X 2 l{t) = 

—a2ir 21(f) + + o.i2Xi2(t)] 

(4 4) 

^23(t) = 

—a23.r 23(f) + n23(0['^2(i) + fii2-i^i2(f)] 

(4 5) 


In the above set of equations OLjk{t) is defined as the fraction of the traffic routed on 
Imk (],k) from the total traffic arrivmg at node ) Since there is no accumulation of 
traffic at the nodes, we have the normalizmg conditions, 
cin{t) + a'i3(f I = 1, Q2i(t) -H otn{t) = 1, 0 < Q.jk{t) < 1 for all (),k). 

Whenever for any Imk (],k), the expression a^kXjkit) is greater than Cjk, that link 
goes into saturation and the term a^kX^kii) is to be replaced by the constant 

The problem of synthesismg the optimal routmg strategy for this network can 
be stated as follows' 

Given the link parameters ai2, ai3, a^i, a23 and the channel capacities Cn, C13, C21 
and C23 of the network whose system dynamics is given by the Equations (4 2), 
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(4 3), (4 4) and (4 5) find the routing variables auit), aisit), a 2 iit) and a 23 (t) whic±i 
satisfy the normalizing conditions, so as to mmimise the performance mdex 



of the network for the time span [0, T] of operation. 

The rationale behmd choosmg the above criterion J as the performance mdex is 
that a waitmg cost is mcurred at a rate proportional to the number of customers m 
the system. 


4.3 Analysis of the Linear Mode 


Assumption 4.3.1 We assume in this section that all the Imks of the network have 
mfmite channel capacities Therefore the network operates m the Imear mode for 
any input traffic Xi{t) and \ 2 {t) 

We find the optimal rouhng variables by applying Pontryagin's Maximum prin- 
ciple [22,23] to the system (4 2), (4 3), (4.4) and (4 5) The Hamiltonian H for the 
system is given by H = where 


Pliit) 

pM 

p = 

P2l(f) 

. P23{t) _ 

and 

Xi2{t) 

£ = 

X2l{t) 

_ 

In the above, pnit), Pizit), p 2 i{t) and P 23 {t) are the costate variables. 

Accordmg to the maximum prmciple, the optimal state and costate variables satisfy 
the followmg necessary condihons. 



4 3 Analysis of the Linear Mode 


79 


(i) P]k = -dH/dxjk -wiihpjkiT) = 0 

(ii) Xjk = dHIdpjk- 

(lii) On the optimal trajectory, we have Hopt = nrima_,fc H{xjk^Pjk, o^jk)- 

It is easily argued that mmimismg H w.r.t a^ki^Ys is equivalent to mirumismg the 
expression, q:i2(pi 2 - Pi3)(Ai + 021X21) + Q;2i(p2i - pTs'jiM + au^iz)- Here, the terms 
(Ai + 021X21) and (A2 4 - 012X12) are non-negative. And as the non-negative routmg 
variables au and 0121 are bounded by a value equal to unity, the optimal routmg 
strategy is the bang-bang type of control [ 23 ] with the followmg possible regimes of 
operation. 

Regime 1 : pi3(f) > Pi2(f) and P 23(0 > P2i{t) with Q;i2(f) = 0:21 (t) = 1 for all t m an 
interval that is a subset of [ 0 ,T]. 

Regime 2 : pi3(f) > Pi2(f) and pzzit) < P2i{t) with 0:12 (f) = 1 and a2i(f) = 0 for all t 
m an interval that is a subset of [ 0 ,T] 

Regime 3 : pi3(f) < puit) and P23[t) > Pziit) with a'i2(t) = 0 , Q;2i(f) = 1 for ail t m 
an mterval that is a subset of [ 0 ,T] 

Regime 4 : pnit) < pnit) and pxzit) < P2i{t) with a;i2(f) = 0 , a'2i(f) = 0 for all t m 
an mterval that is a subset of [ 0 ,T] 

The costate variables pnit), P 2 i(, 0 / Pi 3(0 arid pzsit) are given as the solutions to 
the followmg differential equations 

Pl2(f) = — 1 + ai2Pl2(f) ~ ai2P2l(0<^2l(0 — <ri2p23(f)(l " 1121 (^)) (4.7) 


P2l(f) = 

— 1 -t a 2 lP 2 l(f) — 02lPi2{'t)o:n{t) — a2lPl3(0(l ~ OKizit)) 

(4-8) 

pisii) = 

-1 +ai3Pi3(t) 

(4.9) 

P 23 {t) = 

— 1 + OzsPlsit) 

(410) 


Equations ( 4 . 9 ) and (4 10 ) can be solved mdependently to yield 

1 pa.i3(t-T) 

Pl3(t) = (411) 

<113 

ft3(i) = 


0-23 


(4.12) 
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4.3.1 Optimal Solution and its Properties 

Towards determining the other optimal costate trajectories and switchmgs between 
the various regimes of operation we state below theorems about the conditions in 
which Imk (1,2) and/or (2,1) can or cannot carry any packets. 

Theorem 4.3.1 In the linear mode of operation of all the links of the network, the optimal 
routing strategy is such that incoming packets are not routed on links(l,2) and link (2,1) 
simultaneously over an interval [to,r] with to 6 [0,r] 

Proof : We prove this by contradiction Accordingly let Q;i 2 (t) = Oi 2 i{t) = 1, 

for all t in an interval [to, T] This corresponds to regime 1 with pis{t) > puit) and 
P23{t) > j32i(f)/foralltm[to,r] But Equations (4 7) and (4 8) with 0:12 (f) s Q 2 i(f) = 1 
reduce to 


P 12 — ~1 + ai 2 (pi 2 — P 21 ) (4-13) 

P 21 = -1 + a 2 i(p 2 i -P 12 ) (4.14) 

with the boundary conditions pn^T) = P 2 i{T) = 0. The solutions to the above 
Equations (4 13) and (4 14) are 

Pi2(f) = P2i(f) = T - t, Vt 6 [tQ,T] 

I _ e“i3(t-n) 

But [T — t) > Vt 6 [to, T) and for ais > 0 

<^13 

Therefore pi 2 (t) > Pi3(f)/Vf ^ [to,T) Similarly p 2 i(f) > P23(f)/ Vt e [to,^) 

The last two inequalities contradict the hypothesis that the system is operatmg 
m regime 1 over the interval [to, T] This concludes the proof 


□ 

Theorem 4 31 simply asserts that the optimal routing strategy forbids operation 
that ends m regime 1 

Havmg seen that the optimal routing strategy is one in which mcommg packets 
are not simultaneously routed over Imks (1,2) and (2,1) m any interval that ends m 
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T, we now state the conditions under which the mcoming packets are never routed 
on these links for any interval that is a subset of [0, T]. 

Theorem 4.3.2 In the linear mode of operation of all the links, if the link parameters satisfy 
any of the following sets of conditions, 

(l) 0,23 > fll3 > <^12 
(it) ai3 > 023 > <^21 


(ill) 013 > fll2 023 > *^21 

then the system, under the optimal routing strategy, operates in regime i for the entire 
duration [0, T] 

Proof : We shall first show that under any of the three sets of conditions, the 
system has to end m regime 4 We prove this by a contradiction as follows 
Consider that the system is operating m regime 2 m an interval [fo , T] The equations 
forpi 2 (t) and P 2 i{t) are given as 


Piiit) - ~1 + auPn{t) - anP23{t) (4 15) 

P2l{t) = -I + Cl2lP2l{t) - a2lPl2{t) (416) 


withpi2(T) =P2 i(T) = 0 

Usmg (4.12), Equation (4 15) can be solved to obtam, Vf G [to, T], 


Pnit) = 


2 — 2 — Qa.\i{t-T) _ ga23(t-T) 


+ 


+ 


Oi2 023 {0-12 — 0,23) 

Denoting by q(t) the last two terms m Equation (4.17) i.e. 

2 — Q^^Tsit—T) ga 23 (£-T) _ gauit—T) 


q(t) 


023 


023 ~ a \2 


(417) 


(418) 


Observe that q{t) (defmed above) is non-negative and monotonically decreasmg 
over [0, T] with g(T) = 0 smce 



ga23(t-T)_ga22(t-'7') 
a23— ai2 


} 


= { 


<0,Vf 6[0,T) 


0 


att = T 
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Hence p\2{t) > 


\ _ Qauit-T) 

ai 2 


. Vi6[fo,T’] 


For the system to operate m regime 2 , we must have 

Pizit) = > Pn(t) 


Therefore, we must have 

1 _ g“l3(t-T') 


<213 


1 _ pO-nit—'r) 

> , yte[to,T), 


ai 3 ai 2 

which implies that the system could possibly end m regime 2 only if ai2 > ais 
Further, as puit) given in (4 17) is symmetric w r t and 023, by a similar argument 

it also follows that regime 2 could possibly be the termmal regime only if 023 > ai3 
Under any of the three sets of conditions, one of these inequalities (ai2 > and 
<223 > <213) IS violated and therefore the system cannot end in regime 2 

An analogous reasonmg on the nature of P2i{t) and P23{t) dynamics of regime 3, 
leads to the result that the system could possibly end in regime 3 only if 013 > 023 
and 021 > ^23 Under any of the three sets of conditions, one of these mequalihes is 
always violated and therefore the system cannot end in regime 3. Since by Theorem 
4 3 1, the system can not end m regime 1, it follows that under the conditions (1), 
(11) and (ill) the termmal regime is regime 4. 

Corresponding to the termmal regime 4, the dynamics of pnii) and P2i(t) are as 
follows 

1 


and 


Pnit) = 


P2l(^) 


pO-n{t-T) 2 — g“23(t— 2’) p°-n(t-T} _ ^a^sit-T) 

H + 


<212 


<223 


2 — g“2i(i-2’) 2 — g 


(ai2 — 023) 


a2i{t— T) _ „ai 3 {t-T) 


+ 


+ 


<221 <213 (Ct21 — <213) 

It IS easily argued that (the argument is the same as used m the mitial part) under 
any of the three sets of conditions, the dynamics of pi2(f)/ Pnit), p2i{t) and P23{'t) of 
regime 4 are such that 

Pu{i) > Pnit), Vf6[0.r) 

piiii) > pnit), vf e [0. r) 
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Hence the system operates m regime 4 for the entire duration [0, T] under any of 
the three sets of conditions (i), (ii), and (lii). This concludes the proof. 


□ 

Now we show that the system has to end m regime 4, regardless of the non- 
negative values of a,j. 

Theorem 4.3.3 In the linear mode of operation of all the links of the network, under the 
optimal routing strategy, the system always ends in regime 4 

Proof : The followmg statements were proved m the proof of Theorem 4.3 2 

(i) The system possibly ends m regime 2 only if au > ais and 023 > 013 

( 11 ) The system possibly ends m regime 3 only if 021 > a 23 and ais > 023 

Assume that ai 2 > ais and <223 > <^13 Under this condition the possibility of regime 
3 being the terminal regime is ruled out By Theorem 4 3.1, regime 1 can never be 
the terminal regime Therefore the system ends either in regime 2 or regime 4 But 
for both these regimes, dynamics of puit) is the same 

\ _ opilh-T) ^ _ Qa.T2,{t—T) Qa\i{t-T) _ ga23(t-T) 

Puii) = 1 1 

<312 <^23 0.12 — O23 


'I _ g<113(t-7’) _ Q^23{t-T] 

As a23 > (3 i3, > 

ai3 023 

1 _ g“l3(f-r) ^ _ ganitr) 

and as > ais, > , Vi 6 (— 00 , T) 

a-13 axi 

1 _ p‘^u{t-—T) 1 _ pO-'Bit-T) 

Let = + f23{t), where / 23 {i) >0, Vi G (-30.7) 

ai3 023 

1 _ pHl{t-T) 

= H /i 2 (i), where /i 2 (i) > 0,Vi G (-cc T) 

012 

Then, it can be shown that. 



O 12 — ^23 
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It can be proved, as follows, that over an interval / = [to-.T), for some to < T, the 
function pi2{t) IS greater than p\z{t) In other words, m the left vicinity of t = T, 

Puit) > Pi3{t) 

Pu(i)>K3WJf > 0 

ai2 — 023 

Let 012 > 023 Thenpi 2 (f) > pisit) iff y4n > — 

J23(,tj 023 

For t m the vicmity of T, usmg Taylor series expansion around T, 


fujt) 

/ 23 W 




Ol3 


^aiz(t—T) 


O 12 


1 _ g“i3(t— T') 

oii 

012 ~ Q13 
023 — Oi3 ’ 


I _ g“23(t-l’) 

O 23 


after neglectmg terms contammg {t — T) and its higher orders 

012 ~ Oi3 O 12 

Since > — , 

023 ~ O 13 023 

it follows thatpi 2 (t) > Pizit) in some interval [to,T) (The argument for the case 
023 > 012 IS along similar Imes as above) Thus the expression forpi2(0 ^.nd pi 3 (f) 
in both regimes 2 and 4 are such that pui^) > Pizi^) for some mteri'al ending 
with T Therefore it follows that the system can never end in regime 2. By a similar 
argument as above, concerning the dynamics of P 2 i (0 and P 23 (i)/ it can be concluded 
that the system never ends in regime 3 Hence it follows that the system, under the 
optimal routing strategy always ends in regime 4, regardless of the non-negative 
values of the Imk parameters This concludes the proof 

□ 


Theorem 4.3.4 In the linear mode of operation of all the links of the network, under the 
optimal routing strategy, the terminal regime 4 is never preceded by regime 1 
A necessary and sufficient condition for the terminal regime 4 to be preceded by regime 2 is 

__ g ^12'e g g— ^12!^ — g ^23!^ ^ — g ^13!' 

1 1 <; 

O 12 0.23 0x2 — 023 <^13 
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which for large enough T, reduces to the inequality 

J_ + i_ < J_ 

ai2 <223 <213 

A necessary and sufficient condition for the terminal regime 4 to he preceded by regime 3 is 

\ _ g-O'ZiT 2 — g““-i32’ g— 0132’ 2 — g-OB^ 

1 1 ^ 

<221 <2i3 <221 — <2i3 <223 

which for large enough T, reduces to the inequality 


i ^ 

<221 <213 <223 


Proof : The dynamics of puit), Pi\{t), P\s{t) and pn{t) m the termmal regime 4 are 
given as the following- 


Pl2(f) = 
Pl\{t) = 
Pis{t) = 
P23(f) = 


1 _ Q°-12il-T) 

h 

<212 

1 _ gOnCt-T) 

+ 

<221 

1 _ gOisCf-T) 

<213 

\ _ QO-Tzh-T) 

<223 



As shown in the proof of Theorem 4 3 2, if ais > aas then pi 2 {t) as given by the above 
expression will be greater than pi3(0 m the enhre mterval [0, T) But if 023 > ai3, 
then P 21 (f) > pTsi't) S T) Since either of these two is always the case, it follows 
that either puit) > Pizii) or P2i(0 > Pisif (or possibly both) for the entire duration 
[0 T) For the termmal regime 4 to be preceded by regime 1, there must exist some 
to e [0, T] when puito) = Pisito) arid p 2 i(fo) = Ptsito) Since this cannot be satisfied 
for any to, it follows that the termmal regime 4 can never be preceded by regime 
1. It also follows that a necessary and sufficient condihon for the termmal regime 
4 (m which pi 2 {t) > pn(t)) to be preceded by regime 2 (m which pn(t) < Puit)) is 
Pi2(0) < Pl3(0). 
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which for large enough T, reduces to the following 

ai2 <123 <ll3 

Similarly, a necessary and sufficient condition for the termmal regime 4 to be 

preceded by regime 3 is P2i ( 0 ) < pn (0) 

i.e 


1 1 

^21 ^13 ^21 ~ ^^13 0.23 

which for large enough T, reduces to the inequality 

111 

1 <; 

021 <ll3 <l23 

This concludes the proof of Theorem 4 3 4 . 


□ 

Towards proving Theorem 4 3 5 we make use of the following lemma. 

Lemma 4 . 3.1 For any choice of the parameters 012, 013, 023 such that an > 0 , 013 > 0 and 
023 > 0/ the functions 


Puit) 

and pn{t) 


j[ _ 1 _ g<l23(t— T") g112(<— T") _ QO-nd-T) 

1 1 


012 

_ gai3{<-7’) 
<ll3 


<l 23 


O12 — O23 


can have at the most one point of intersection in the interval (—00, T) 


We make use of the followmg result by Pontryagm [ 22 ] stated below without proof 
towards provmg the above lemma. 

Lemma 4 . 3.2 Let Xi, X2, ,Xm be distinct real numbers, and let fi{t), f2{t ), . ,/m(f) be 
polynomials (with real coejficients) of degree ki,k2, . .km respectively Then, the functions 
+ f2{t) + + has at most ki + ^'2 + - + + (m - 1) roots 
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Proof : Let us assume that pnit) and pi 3 {t) have two pomts of mtersection 

m (— oo,r) (denoted as ti and t 2 where ti < ^ 2 ) In other words the function 
(Pizit) — Pi3{i)) IS zero at t = and at t = t 2 Note that (pniT) — pislT)) is also 
zero From Rolles Theorem, it can be concluded that the derivative of the function 
(Pnii) — Pi 3 (f)) is zero at least once m the open mtervals {ti,tz) and Thus 

the function (pi 2 — pis) has at least two roots m the mterval (- 00 , T). 

The expression for (pnit) - Pnit)) is given as 


Pn{t)-Pi3{t) 


(ai2 — azi) (ai2 — 013) 


At t = T,p\2 — Pi3 = 0 

Thus the function pi2 — P13 has at least three roots m the mterval (—00, T] But by 
Lemma 4 3.2, this function (which is a sum of three exponential terms weighted 
by constants) can have at most two roots m {— 00 , 00), Thus the assumption that 
Puit) and pi 3 (t) have two points of mtersection in the mterval (—00, T) leads to a 
contradiction 

The above arguments can be easily extended to prove that the assumption pnit) 
and pi 3 (f) has n (where ?? > 2) pomts of intersection leads to the conclusion that the 
function (pi 2 — P13) has at least n + 1 roots. Smce this can not be the case, it follows 
that puit) and p\ 3 (t) can not have two or more pomts of mtersection m the mterval 
(—00, r) Hence the lemma. 

□ 


Assummg that the termmal regime 4 is preceded by regime 2 (regime 3), we now 
show that such a regime 2 (regime 3) couldn't have been preceded by either regime 
1 or regime 4 or regime 3 (regime 2) 


Theorem 4.3.5 The system, under the linear mode of operation of all the links with the 
optimal routing strategy, can not end with any of the following sequence of regimes 


(a) regime l^regime 2-^regime 4. 

(b) regime 3— ^regime 2-^regime 4 



(c) regime 4-^regime 2-^regime 4 

(d) regime 1-^regime 3-^regime 4 

(e) regime 2-^regime 3-^regime 4. 

(f) regime 4-^regime 3-^regime 4 

Proof : (a) We prove this by contradiction as follows: 

Let I\ = [to, ti), h = [ti,h) and = {tz, T\ be the intervals corresponding to regime 
1, regime 2 and regime 4 (modes of operation) respectively. Durmg/i,pi 2 (f) < Pi 3 (t) 
andp 2 i(^) < PTzi't) and 


Pn{t) = -1 + ai2Pi2(i) - ai2P2i(^) (4 19) 

P2i(^) = “1 + 021^21 (i) — a2iPi2(f) (4 20) 

Tlie solution to the above, m terms of the initial values pi 2 (to) and P 2 i(to) are given 
as 


Pnii) 

P2i(i) 


, a2lPl2(^o) + ai2P2l(to) ai2(Pl2(i‘o) — P2l(^o))^:^“'^'*’“”^^^ 

— Cq b “r ( i~ 


ai2 + 0.21 


ai2 + 021 


(4 21) 


to — t + 


ai 2 P 2 i(to) + azipnito) a2i{pn{to) - P2i(i^o))e'°‘^'*'°^^^^' 


012 + a.21 


012 + 021 


(4.22) 


The slopes oipuit) and pzi{t) are given as 

Pu(t) = -l + oi2[pi2(io)-P2i(^o)]e^“'^'^“^'^^‘"‘‘-^ 

P2i(t) = -H-a2ib2i(to)-pi2(to)]e^“'^+“^»^'‘-‘'’^ 

X — e«13(i-r) X _ Qa23it-Ti 

Since pisit) and P23{t) = 

' 013 ^^23 


Pnit) 

P73{t) 


_gai3{t-T) 
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□ 

The implications of the Theorems 4.3.1 to 4.3.5 can be summarised as the followmg’ 
In the linear mode of operation of all the links, under the optimal routing strategy, 

• The system always ends m regime 4, m which the direct links(l,3) and (2,3) 
are used. 

• It has at the most one inter-regime switching in [0, T] 

• The system never enters regime 1 m any mterval that is a subset of [0, T]. 

• A necessary and sufficient condition for the system to start m regime 2 is 

1 _ Q-^nT I _ Q-mT Q-auT _ g-aar \ _ 

h 1 

ai2 CL-B 0,11 ~ 073 Oij 

• A necessary and sufficient condition for the system to start m regime 3 is 

1 _ £-“ 21 ^ 1 — 1 — 

1 h ^ ~ 

021 *^13 <^21 <213 “23 

4.3.2 Optimal Routing Algorithm: Implementation 

From the above discussions, it follows that the optimal routing algorithm can be 

implemented on a network in the following manner 

Step 1: Estimate the link parameters an, ois, 021 , and 033 of the network 

Step 2 : Check if they satisfy the followmg mequality 

1 _ p-°-\ 2 r 1 _ g-“ar 1 — 

^ ^ ^ I — < 

ai2 <^23 ^12 “ ^23 ^13 

If the above is satisfied, then compute the switchmg mstant from the equation 

I ^a^3{t,-T) l^ganits-T) I ^ ^anits-T) _ ^a:a{ts-T) 

^ ^ = I — + h 

ai 3 “12 “23 

The routmg strategy is specified as . 

ai 2 {t) = 1 a 2 i(f) = 0,fort G [0,f,), 


a\2 “ ^23 
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auit) = 0, a 2 i{t) = 0, for t e T] 

On the contrary, if the link parameters satisfy the followmg mequality 

1 1 ^ 

dll <^13 <^21 <^13 ^^23 

then compute the switchmg instant ts from the equation: 

2 — e^23(^a“T) 2 _ QO-llits—T) 'y _ ga|3(t5-T) Q0.2\[ta-T) _ qO.\3(^s~-T) 

= 1 1 

0^23 ^21 ^13 ^21 — <^13 

The optimal routmg strategy is specified as: 

o^nit) = Oj = 1) for f ^ [0) f*)/ 
anit) = 0,q;2i( 0 = 0, fort G [ts.T]. 

Step 3: If neither of the two conditions of step 2 are satisfied, then the optimal 
routmg strategy is 

Q;i2W = o,a2i(f) = o,vte[o,r] 

There are some interesting features of the above results regardmg the network 
operation under the optimal routing strategy If the network operation is confmed 
to the linear mode for the entire duration, then the routmg strategy depends only 
on the topological parameters of the network. Such a case where all the Imks 
operate m the linear mode often arises m practical situahons, if the traffic load on 
the network is low, and/or if the channel capacities of all the Imks are very high 
A topologically determined routmg strategy can be easily implemented on an on 
Ime basis. 

Another interesting feature of the optimal routmg strategy under the linear mode 
of operation of all the links is that during no mterval of the network operation, 
packets are routed onto both the links (1,2) and (2,1) simultaneously This property 
of the optimal routing strategy, which we term as the loop-free property will be 
shown to hold good even when one of the direct links of network is of fmite channel 
capacity We prove this result m the Sechon 4.4. 
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Figure 4.2. State variables as functions of tune for case 1. 

4.3.3 Numerical Examples 

The above results regarding the nature of the optimal routing strategy can be 

illustrated by means of the followmg three cases 

Case 1 : Consider a network with the followmg Imk parameters 

ai2 = 0 5, ai 3 = 0 25, aai = 0 2 , 023 = 0 8 . 

The initial buffer occupancies are assumed to be zero. The input traffic Ai (t) = 
X 2 (t) — 20 packets /unit time 

It can be easily verified that the above Imk parameters satisfy the necessary and 
sufficient condition (given by Theorem 4 3 4) for the network operation to start m 
regime 2. The system of differential equations m the state and costate variables 
(which m this case forms a (decoupled) two pomt boundary value problem) is 
solved numerically. Figure 4 2 shows the buffer occupancies as functions of time 
for this case Figure 4 3 is the costate variables correspondmg to this case The 
network operates m regime 2 m the interval [0, 5] and subsequently m regime 4 m 
the interval (5, 10]. Figure 4 4 shows the variation m the performance mdex J as 
the switchmg instant is varied over the mterval of network operation. 

Case 2 : Consider a network with the followmg link parameters: 
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Figure 4 3: Costate variables as functions of time for case 1 



Figure 4.4; Performance variation with the switchmg mstant for case 1 


ai 2 = 0 3, ai 3 = 0 6 , aai = 0 9 , 023 = 0 2. 

The mitial buffer occupancies are assumed to be zero The mput traffic Xi{t) = 
Xoit) = 20 packets /umt time. 

The network operates in regime 3 in [0, 8 1) and m regime 4 dunng the mterval 
[81,10]. The above choice of the Imk parameters sahsfy the necessary and sufficient 
condition for the network operation to start m regime 3 Figure 4.5 shows the buffer 





4.3 Analysis of the Linear Mode 


94 



Figure 4.5 State variables as functions of tune for case 2. 



Figure 4 6 Costate variables as functions of bme for case 2. 

occupancies as functions of time for this case. Figure 4 6 shows the costate variables 
as functions of hme. The variation in the performance mdex J as the switchmg 
mstant (from regime 3 to regime 4) is varied over the mterval of network operation 
[0, 10], IS shown m Figure 4 7 

Case 3 : Consider a network with the followmg link parameters 
ai2 = 0 4, ai3 = 0 5, a2i =0 2, = 0 3. 
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Figure 4 7 Performance variation with the switchmg mstant for case 2 



Figure 4.8 State variables as funchons of hme for case 3 

The initial buffer occupancies are zero and the input traffic Ai(f) = A 2 (f =20 
packets /unit time. 

Figure 4.8 shows the buffer occupancies and Figure 4 9 shows the costate variables 
for this case The choice of the link parameters result in a regime 4 operation for 
the enhre mterval [0, 10] 






Figure 4 9: Costate variables as functions of time for case 3 

4.4 Networks with a Direct Link of Finite Channel 
Capacity 

In this section, we examme the properties of the optimal routing strategy for the 
three-node network in which one of the direct links has finite channel capacity 
Using an argument similar to the one used m the previous chapter for the two- 
node case, we show that the routmg strategy at a source node [the one which has 
a direct link is of finite channel capacity] need not be bang-bang There could be 
mtervals in the time span of network operation during which this routmg variable 
[ either Q;i 3 (it) or a' 23 (t)] takes non-zero, non-unity values We prove that over such 
intervals the value of this variable depends on the charmel capacity of the associated 
Imk and on the total input traffic to that node. We also prove some mterestmg 
results pertaining to the possible modes m which the network operation can end, 
and provide numerical examples to substantiate these results Furthermore, we 
establish the loop-free property, as m the Imear case of the previous secfaon. These 
results are stated as theorems m the subsections that follow 

In the analysis that follows we assume that Imk (1,3) has fmite channel capacity 
All other links of the network are assumed to be of mfmite charmel capacity 
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The dynamic evolution of the state of the network is then given by the following 
set of differential equations: 


X12 = 

— ai2Xi2(f) + ni2(t)[Ai(t) + a2\X2i{t)] 

(4.23) 

a:i3 = 

+ Q!i3(i)[Ai(f) + 021X21 (f)] 

(4 24) 

3:21 = 

— 021X21 (t) + 0:21 (f) [A2(f) + 012X12(4)] 

(4 25) 

2^23 = 

—023X23(4) + 0:23(4) [A2(4) + 012X12(4)] 

(4.26) 


where the function fnix^s) is defmed as 


/bC'Tis) = 


ai3Xi3 lixis < Cis/ais 

Ci3 otherwise 


(4 27) 


The roufang variables ai 3 {t), 0:21 (f) and 0:23 (f) have the same mterpretation 

as in the previous section , and the normalizing conditions which they must satisfy 
remain imchanged from those given in the Section 4 2 

The performance mdex J, that is to be mmimised is the total buffer occupancy time 
defined (as in the earlier section) below: 

rp 

j f + Xi3{t) + X2l{t) + X23(t))dt 

Jo 


Thus the problem of finding the optimal routmg strategy is formulated as the 
optimal control problem of finding the control variables Q;i2(f)/ anit), aziit) and 
Q23(t) for the system given by the Equations (4 23)/(4.24),(4.25) and (4.26), which 
mmimise the performance mdex J 

We investigate the above optimal control problem m the framework of Pontrya- 
gm's Maximum principle, as done m the previous Section 4 1. Smce the funchon 
/i3(^i3) has a discontmuity at xi 3 s we consider a class of control problems m which 
the function /i3(xi3) is replaced by fu{x\^) defmed as below 


/[ 3 (-^- 13 ) 


id 

- (xi3 - Xi3c)^ 

. <^13 


+ ^13 


if Xi3 > Xi3c 
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where Xisc = and r > 0 

Comments: 

As in the case of Chapter 3 the function /{^(xis) is obtained by drawing an arc of 
radius r, tangential to the lines fisixis) = aijxis and /i 3 (a;i 3 ) = 

And as r -t 0, 

(l) Xi3i, Xt3c — t a:i3s 
(ii) fi3(xi3) -t /i3(a;i3), Va;i3 > 0. 

dfT' 

The function is continuous m xis (Vxi 3 > 0) and is given by 


df{3{xi3) 


<^13 


dx 


= < 


^13c~^13 


13 




0 


if Xi3 < X13; 

if a:i3i < 3; 13c < Xi3c 

if Xi3 > Xi3c 


The Hamiltonian for the above class of problems is given as 

H' {jf , P' , cv’ ) = xJs (f) + x\2 {t) + v’21 {t) + X^ 23 (t) + Pl 3 ^'l 3 + Pu^ll + Pll^k + PlS^h 
Substituting the dynamics given by Equations (4 23)-(4 27), we get 


-ff’ ( t'", — [ 2 ^ 13 (i) + 3 ^ 12(0 + ^‘ 21 ( 0 +^23 (^)] 

+ (Pl2 -Pl3)“l2W['^lW +^l2l3:2lW] 
+(P2i - P2i)^2iii){Hi) + anxnit)) 
-auPu^n + Puihii) + 

+P^(A 2 (f) + 0123:12) “ fn{^ 13 )Pl 3 
-a23Pz3X^23 - ^l2l3:2lP21 


Minimising the Hamiltonian wrt. Q:i 2 (f) 3-nd Q! 2 i(^) l^^ds to the followmg condi- 
tions 

(1) If p[2it) > pi 3 (f), then a\2it) = 0 and = 1 

(2) If p[2{t) < p[3{t)> then a\2{t) = 1 and 0 ^ 3 (f) = 0 
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(3) If then = 0 and = 1 

(4) If P 2 i(i) < P^{i), then = 1/ and a^{t) = 0 

If Vt € /, Pi 2 (f) = Pui^)/ then o:i 2 (t) = 1 and are not specified by conditions 
(1) and (2). 

If Vt G /, P 2 i{t) = P^{t), then Q; 2 i(t) is not specified by conditions (3) and (4). 
According to the Maximum prmciple, the optimal state and costate variables sahsfy 
the followmg necessary conditions: 

(i) = -§S^ with the boundary conditions p^ki'T) = 0. 

^ 

From (i) above, the differential equahons for the costate variables are given 
as 


T 

Pl2 

r 

Pl3 

T 

Pll 


-1 + ai2p^2 ~ ^^izcvnPn “ 
dx\2 

— 1 + 021^21 — ®21Q;i2Pi 2 “ ^ll^isPlS 


Pl3 = -H-a23P3 


(4.28) 

(4.29) 
(4 30) 
(4.31) 


along with the boimdary conditions Pi 2 {T) — Pi^iT) = P 2 i(^) = PhC^) — 0 
Equation (4 31) can be solved mdependently to obtam 


Plsii) = 


1 _ Q<^nd-T) 


^23 


From the differential Equations (4.28)-(4 31) m the costate variables, certam mter- 
esting observahons which are stated below as lemmas, can be made regardmg the 
nature of the optimal routing strategy 


Lemma 4.4.1 There exists no interval I = [to)fi]/ 0 < fo < ti < T’ such that it € I, 
Pnii) = PislO p[^{t} = p^(t). 
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Proof : (By contradiction) 

Let I = [to, ti] be an interval during which = Phit) and 
Then Pi2 = ^*13 Pii = / Vt 6 / 

This implies that Vt E I 


Hence 


ai2{ph-P2i) = 
a2liP21-Pl2) = 

dxU 


dx^^P^3 

0-23Ph. 




(A). 


It can be argued as follows, that the right hand side of the Equation (A) is negative' 
The function P23(^) which is given as 

2 _ g“23(t-^) 


= 


<^23 


is positive m [0, T) The function Pi3(t) is also positive in [0, T) since 


Pi3(i) = {[ 


‘T _ r 
exp 




""13 dr][exp-^° 


13 


IS a product of two terms which are both positive m [0 T) The link parameters au, 
a2i and 023 are all positive constants 

The left hand side of the Equation (A) is non-negafave since ^ > 0, Vf € [0,T] 
Hence Equation (A) can not hold true in any mterval I which is a subset of [0, T) 
Thus the assumphon of the existence of an interval m which p^t) = p\pt) and 
P2i{t) = P23{t) leads to a contradiction 


Lemma 4.4,2 There exists no interval I = [fo,^i]/ 0 < fo < ^i ^ that it E I, 

Pliit) = Phii) andp\2{t) < p[^{t) 

Proof : Let us assume that dunng some mterval I = [fo, h], phit) = Ph 0 ^^id 
Pi2(^) < P'lsi^) The differential equations, for p{ 2 {t) 3 nd p^^it) m the mterval I are 
given as; 

P12 = — 1 + ^.uiPn ~ P21) 
and P21 ~ T *^21(^21 ~ Pi2b 
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Since pli = It follows thatp^^ = during I 


Therefore asi - p\^) = 023^^ 


1 e r' - ~ ^23) r 

1 e P12 fe 

021 


Consider the case where 021 = 023. 


<121 = 023 P5i2(t) = 0,Vt G J. 

p \2 = -1 + ai 2 pj 2 - 012P21 

= -(1 + O12P21) <0 Vt G / (B) 

But inequality (B) can not hold true since, if is identically equal to zero during 
the entire interval I then p\2 also has to be zero during that interval 
Consider the case where 021 i=- 023. 




(02I — 023 ) 
O2I 

(02I — 023 ) 




Pnii) 


021 

(Q 21 - ^73) a„(t-T) 

O21 

l+pytj = i_. K-»a) ,,.»|.-r) 

O2I 


From the differential equation for the costate variable p’^it), we know that 

1 + Pl2{t) = Oi2(pn(t) - Pllit)) 

Hence 1 - ((021 - 023)/o2i)e““(‘-^) = a^2ipl2{t) - Pnit)) 


= Oi2( 


(021 — 023) , (1 — e 


1 )- 


a23{t-T)) 


O2I O23 

After rearranging the terms in the above equation, we get the followmg: 


(1/ 012 + 1/021) 


= VfGl ...(C) 


((O21 — 023)/0l202lj + I/02I 
Note that the left side of Equation (C) is a constant while the right side is a mono- 
tonically increasing function of time and therefore it can not be satisfied. Thus 
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from the assumption of the existence of an interval I during which P 2 r (0 = P23(^) 
and Pi2{t) < Pi3(t)/ we arrive at a contradiction in either of the two possible cases 
[a2i = ^23 or 021 / o-zi]- Hence the lemma. 

□ 

Lemma 4 . 4.3 There exists no interval Iq = [to, ti\, 0 < to < ti < T, such that \ft G /q, 
Phii) = Phi't) Pi\{t) < P'M- 

Proof : Let Iq = [to, ti] be an interval during which p\2{t) = and p 5 i (0 < 

P23(t)- The routing variable 0:23(0 is identically equal to zero in Iq and therefore the 
dynamics of p^2(^) P2i(^) i^ ^0 given as: 

Pu = + «i2[p[2 - P21] 

P 2 I = + «2i[P21 - Pli] 

Since p{2 = pIo^ Pu = Pu ^ ^o- 
We know that pjg = -1 + ^Pi3 > (since ^ > 0 and p\^ > 0 ). 

Thus P22 ^ i^ Pi2(^) ^ P2i(^)' P21 ^ “T 

Vt G Iq- 

Thus the following statements hold true : 

For all t in the interval Iq, 

(a) p[2{t) > p^i(t) 

(b) P^ 3(0 >P 2 l (0 

(c) p5i(i) < -1 

(d) P23 - P21 ^ ^ 23 Ph > 0 - 

From (d) it can be concluded that (p^jft) - p 5 i(t)) is a monotonically increasing 
function (and is positive as per the assumption that during Iq, p^{t) > phit}) in Iq. 
Therefore 

1 . Iq can not be a terminating regime since p^(T) > P21 (T) violates the transver- 
sality condition. 

2 . Iq is followed^ by an interval (howsoever small) in which phit) < p^ t) and 

implicit in this inference is the fact that the costate variables are continuous functions of time 
in [0, T] 
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Let I\ = [ti-tz] where ti < ti < T (for some tz), denote this interval that follows Iq 
during which Pziit) continues to be less than We shall examine the nature of 

the costate variables in /i. 

Note: A transition from an interval Iq in which Pzi{t) < p^{t) and p[z{i) = Phi^) 
to an interval in which Pziit) < and Pn (0 7 ^ Pnii) can arise only from two 

possibilities : case 1 , in which p^2(^) < Ph{^)> case 2 , in which Piz{t) > Pisit). 

Case 1 : 

If Pi 2 (^) < Pisi^) ^ A/ then the dynamics of P|2(0 ^d Pziii) in h are given as 

Pu = -l + ai 2 (Pu-P 2 i) 

Pn = + «2 i(P2i -P u) 

with the initial conditions plzih) > P2i(^i) follows from (a)]. 

Since p^2 “ 2^21 = (^12 + a 2 i){Pn - P21) 

Pu(t)-Pn(t) = we/,, 

and consequently P 2 i (0 ^ Vt G A. 

Since P23 = — 1 + 0.23P23 > Ph — Pzi>^'^'^ ^ A* 

Hence (P 23(0 - Pzii't)) continues to be a monotonically increasing function in A- 

Furthermore pA(^) < Pi2(^) < Pizi^)- 

i.e. pAA) < min[pAA).Pi3(0] Vt G A- 


Case 2 : 

If py t) > pA(A ^ A. then the dynamics of pA(A and pA(A in A are given as 

Piz = -I + <2i2[Pi2 ~ P 21 I 


P 21 


— 1 + 021 [p A — P 13 ] 


Since, pA ~ -1 + 




13 


dx 


Pl3 


13 


P 2 I “ Pl3 


CI21 


[p 21 “ P13] 


dx^ 


PA < « 2 l[P 21 - Pul- 


13 
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At t — ti the initial conditions of Piiih) and pj 3 (h) are such that pliiW) < Pisih) 
[from (b)]. It can then be argued that p^ 2 \{i) ~ Pisit) < 0, Vt e h- Therefore 
Pn — “1 + 1221^21 “Pis] < ~P 2 i( 0 ) continue to be monotonically 

increasing Vt 6 h- 

Furthermore, pl^it) < p\ 2 {t) < p[ 2 {t) 

i.e. pli{t) < min[p^ 3 (t),p^ 2 (t)]. 

Thus in both the cases 1 and 2, all the four statements (a), (b), (c) and (d) (regarding 
the nature of the costate variables in the interval Iq) hold true in A also. 

The above arguments which were used to prove that Iq is followed by an inter- 
val Ji during which the properties stated in (a), (b), (c) and (d) continue to hold 
true, can be extended to show that A in turn is also followed by such an interval. 
Extending the above reasonings to regimes that follows /i (in succession), it can 
be concluded that P 23 (^) > ^ [ to,T]. Since this results in a condition 

P 23 (T) > P 2 i{T) which violates the transversality condition, the initial assumption 
of the existence of an inter\^al Iq with the stated properties is incorrect. Hence the 
lemma. 


□ 


4.4.1 Routing Strategy at node 1 

From the three Lemmas 4.3.1, 4.3.2 and 4.3.3 it can be concluded that during any 
interval in which the costate variables pAit) and pA{t) are identically equal, the 
costate variable pAit) has to be greater than p^(t) and consequently the optimal 
routing variable has to be zero during that inten^al. This implies that at the 
source node 2, all the incoming traffic is routed onto the direct link (2,3) during 
such an inteiv^al. We now establish that at the source node 1, (for the case of r 
tending to zero) a fraction (of the incoming traffic) equal to the ratio of the channel 
capacity of link (1,3) to the total traffic arriving at node 1 is routed onto the direct 
link (1,3) during such an interval. 
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Theorein. 4.4.1 For the control problem in which r tends to zero, the only possible values 
al,it) can take are 0, 1 and 

Proof : It has already been, argued that if during an interval Pi 2 {t) is greater than 
then equals unity and i{pl 2 {t) is less than p[^{t), then 0^3(0 equals zero 
m that interval Let = p[^{t), Vt G J C [0,r]. Then, by Lemmas 44 1 and 

4.4.3, P2i(^) > ^ 

Therefore p^^it) = -I + a^ipnit) - p^sit)) 

Smce p\ 2 {t) = Phit) m J, = P13/ Vt G / 

Hence fa = during/ 

dxl^ Pi2 

dfr 

IS thus a function of t, and not a constant during I 

Comments: This follows from the nature of the solution for Pi2(i) of the differential 
equation m Pi2(0 

Therefore durmg I, x\zi < ^13(0 ^ ^i3c In the limitmg case of r tendmg to 
zero, both xi^i and Xi 3 c tend to X134 Therefore x^^it) has to be idenbcally equal to 
.I’lSs, during / and is zero for the enbre mterval Consequently Q;33(i] equals 
Ai(t)+^2ix' (t) interval durmg which Pi2(t) is identically equal to P2i(f) for the 

case where r tends to zero. 

□ 

In the Section 4 5 4 we shall provide numerical examples wherem the routmg vari- 
able Q;i3(it) takes the value x^{t)+anxn(t) sub-mtervals of network operation 

We now prove the loop-free property of the routmg strategy. 

4.4.2 Loop-free Property 

We have established m Section 4 3 that both the links (1,2) and (2,1) are never 
simultaneously used to carry the mcommg traffic at node 1 and node 2 respectively 
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when all the links of the network are of infinite channel capacity Makmg use of 
the above three lemmas, we can prove that such is the case even when a direct link 
IS of fmite channel capacity. 

Theorem 4 . 4.2 There exists no interval I C [ 0 ,T] during which both al2(t) and 
are non-zero 

Proof : By Lemmas 4 . 4.1 and 4 4 . 3 , if pliii) and are identically equal m an 
mterval I, thenp2i(^) is greater thanp23(t) durmg I and consequently the routing 
variable Q' 2 i (t) IS identically equal to zero m 1 . We shall now establish (via a 
contradiction) that if Pi2(0 is less that m an mterval /, then P2i{t) has to be 
greater than p^{t) durmg such an mterval. 

Let I = [to, h] where 0 < to < ti < T he an mterval such that Pi2{t) < Puit) and 
P2i(0 < PTsi^) for the entire mterval 

Then during I, the dynamics oipuil^) andp2i(f) are given as 

P22 = -1 + aniPu - P21) 

P21 = -1 + a2i(P2i -P12) 

Therefore (p{M - PiM = Write) - Pi, 

Consider the case where Pi2(^o) > Pn(fo) 

Thenpi2(f) > P2i(f)/'^f ^ / and consequently p 5 i(t) < -l,Vt e I 
Smee p^3(£) > - 1 , p^i) “ Pni^) > 0 V£ 6 J and (p^(£) - p^i(£)) is a monotomcally 
increasing function of time. Besides P2i(£) < Phit) < Phi^)- 
i.e. pl^{t) < m2n(p^2(£),Pu(f)) 

We have already argued m the proof of Lemma 4 . 4.3 (see case 1 ) that if the costate 
variables Pni^)' Piii^) an mterval I are such that 

(I) pl^it) < Pi 3 ( 0 /V£ € I, 

(II) (p 53 (£) - p2i(f)) IS a positive and monotomcally mcreasig function m I, 

(ill) plj{t) < mm {Pi 2 (f)/Pi 3 (f)}/'^^ ^ f 
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then the relationship continues to hold true for all t upto T This 

results m the condition p^(T) > pliiT) which violates the transversality condition 
PhiT) = f 2 i{T) = 0 . 

Consider the case wherein phito) > Pizi'^o) 

Thenp2i(0 > ^ 

Therefore P22(^) < — 1, Vi € / 

Since Pi3(i) > —1, the function — Ph{i)) which is positive ( as per the as- 

sumption) IS monotonically mcreasmg in I 
Furthermore, Pi2(t) < mm {P2i(^)/P23(^) } 

It can be argued from the above two conditions (we do not repeat the arguments) 
that they result m the condition that p[2,{t) > Pni^)/ ^ [^o, T] and this m turn 
results m the violation of the transversality condition p[2{T) = Pi2(T) = 0 

Thus we arrive at a contradiction in both the two possible cases (pi2{to) > Pi3(^o) 
or p\2 (fo) < Pi3 (fo) )/ from the initial assumption of the existence of an mterval durmg 
which p\2{t) is less than p\2{t) and p^it) is less than or equal to P23(f) Therefore 
there exists no such mterval in the duration of the network operation 
Thus if Pi2(f) < Pi3(0 over any mterval ( i.e a[2{t) is non-zero), then Q;5i(i) has to 
be zero durmg that interval 

□ 


4.4.3 Modes of Operation of the Network 

We investigate the possible modes m which the network operation can end under 
the optimal routmg strategy. The followmg defmitions are used henceforth 

DEFINITIONS: 

Definition 4.4.1 The network is said to be operatmg m the saturation modeiS) 
during an mterval / if Vi £ /, > xjsc, and such an mterval / is termed as a 

saturation regime 
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Definition. 4.4.2 The network is said to be operating in the lineuT ttiode (L) during 
an interval / if Vt £ I , (i) < ^13;, and such an interval I is termed as a Ivnear vegntiB 

Definition 4.4.3 The network is said to be operating m the transition modeCT) dur- 
mg an mterval I if Vt £ I, xi^i < < xi 3 c, and such an mterval I is termed as a 

transition regime. 

In the hmitmg case as r tends to zero, if Vt £ /, xi3(t) > X33,, then J is a saturation 
regimeiS). 

If Vt £ / , Xi 3 {t) = a'i33, then / is a transition regime{T) 

And if Vt £ /, x'i3(f) < Xi 3 s, then J is a linear regime (L). 

Definition 4.4.4 Lmk (1,2) (Imk (2,1)) is said to be operatmg m Full (F) durmg an 
interval I, if Vt £ /, a\ 2 {t) {oi 2 i{t)) = 1. 

Definition 4.4.5 Lmk (1,2) (link (2,1)) is said to be operatmg m Empty (E) durmg 
/, if Vi £ /, ai2(i) ((a2i(i)) = 0 

Definition 4.4.6 Lmk (1,2) (lmk (2,1)) is said to be operatmg m Partial (P) durmg 
an interval I, if Vt £ /, 0 < ^^(i) (q; 2 i( 0) < 1* 

Denoting the mode of operation of the network by the triplet (eg FFS means 
ai 2 {t) = 1, a'2i(f) = 1, and network m saturation mode) m which the first letter 
stands for the status of lmk (1,2), the second that of lmk (2,1) and the third, on the 
status of link (1,3), the followmg 27 modes are possible 

FFS, FFT, FFL, FES, FET, FEL, FPS, FPT, FPL, EFS,EFT, EFL, EPS, EFT, EPL, 
EES,EET, EEL, PFS, PFT, FFL, PEL, PES, PET, PPS, PPT, PPL. 

Of the 27 above, by the loop-free property (Theorem 4.4 2) the followmg are ruled 
out not only m a termmatmg mterval, but also in any mtermediate mterval of 



4 4 Networks with a Direct Link of Finite Channel Capacity 


109 


network operation. 

FFS, FFT, FFL, PFS, PFT, PFL, FPS, FPT, FPL, PPS, PPT, PPL. 

Since link (1,2) can be operational m partial mode (P) only if we 

can rule out the modes PES and PEL in a terminal regime from the foUowmg 
considerations: 

PES: 

The dynamics of Pi 3 (t) are given as 

Pi2 = + ai2(p^2 ~ Ph)y PnC^) = 0 

Pu = -1, pUt) = o 

The solutions to the above equations are 

'I _ QCLu{t-T) 2 — Q_^73{i~T) r^ai2{t-T) __ ^a23{t-T)\ 

Pui'^) = i 1 ^ 

ai2 023 (Oi2 — 023) 

PisW = 

Since Pi 2 {t) and pjj (t) as given by the above expressions can not be identically equal 
over any interval, Imk (1,2) can not be in partial mode Hence PES can not be the 
mode of operation in a terminal regime 

PEL: 

The dynamics of Pi 2 (*^) Pi 3 (^) given as 

Pl2 = — 1 + Oi2(Pi2 “Pm)' Pll^) ~ 0- 

Pl3 = “1 + Q13Pi3) P'i3(^) “ 0- 


The solution to the above equations are 


Pl2(0 “• 

PM(i^) = 


gai2(i-T) -y 
. + _ 


^anit-T) 


Oi2 

y _ 


0-23 


+ 


(e 


an{t-T) 




{on — 023) 


Ol3 


Smce Pi2(0 given by the above expression can not be identically equal to Px^it) 
over an mterval, link (1,2) can not be m partial mode Hence PEL is ruled out m a 
termmal regime. 
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The modes PEL, EPS, EPL, EPL, EES are also ruled out m a termmal regime 
PEL: 


Pxiif) = 
= 


\ — g“i2(f— 2") _ Q^Tzit-T) /gO-izit-T) _ Qa 23 (t-T)\ 

■ + + - 


^12 

I _ g<ii3(t-r’) 

<313 


<323 


(ai2 — < 323 ) 


As proved m the proof for Theorem 4.3.3 (m Section 4 3), the funchon Pi 2 it) is 
greater than for all t € [to,T) for some to- Hence a5;2(^) can not be 1 m 

a temmal regime. In other words, Imk (1,2) can not operate m Full mode m a 
termmal regime if link (1,3) has a Imear dynamics. 

EPS: 


Ph = - 1 , Pi3iT)=0 
Hence = T-t 

P 21 — ~1 + i32i(P 21 ~ Pia)' Pzii"^)^^- 

P 2 l(^) “ T — t. 

P 23 ~ “ 1 +< 323 P 23 > 

I _ QO-Mt-T) 

Since = T -t > p 23 it), ak(^) can not be unity. Thus link (2,1) can not be 

operate in Full mode m a termmal regime if Imk (1,3) is m saturation 

EPL: 

1 _ g“zi(i-T’) 1 _ g“i3(i-3’) QO-iiit-T) _ Qaii(t-T) 

Since plS) = - + + (an - a, 3) 

is greater than p^(t) = . for allt m some mterval [to, T], 

a 2 i (t) ^ 1 m a termmal regime. Hence EPL mode of operation m a termmal regime 
IS ruled out. 

Note: We proved the above result that m an mterval endmg with T, pl^ (t) is greater 
than (t), in the proof for Theorem 4 3 3 
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EES: 


p'M 

Pnit) 

Pl3(^) 

Therefore a\2{t) 


T-t 

j[ \ _ _ gCL 23 (t-T) 

ai2 023 (oi2 ~ <^23) 

T-t> p[2{t) 

1 


i.e. link ( 1 , 2 ) can not be operating in Empty mode. 

FET: 

It can be argued as follows that m the limiting case m which r tends to zero, the 
network can not operate in FET mode. 

al2{t) = 1 in an mterval (denoted as I) durmg which the network operation is m 
FET mode 


Therefore xlj = E I 

As r -> 0 , a:i3 = —Cn 

For the interval / to be a transition interval ri3(t) has to be equal to 'it e I 
Since this can not be satisfied if the dynamics of a;i3(t) is as given by 2:13 = -C13 m 
I (since xxz{t) is then a monotomcally decreasmg function), FET mode of operation 
is ruled out not only m a termmal regune but also m any mterval of network 
operation, for the case where r tends zero. 

EFT: 

The EFT mode of operation is also ruled out m a termmal regime for the followmg 
reasons: 

Let I = [to, T] be an mterval durmg which the network operates in the EFT mode 
Durmg /, 2:13; < J'’i3(i) < ^i3c stid therefore ^ < ais 

Hence pl^ = -1 + 'PrPi'i < + “13P13 Vt G I — [to, T]. 

ax 12 

We have the boundary condition p\o{'^) = 0 . 

It can be argued that p\i{t) which satisfies the above mequality m the mterval I is 
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such that 

Consider now the dynamics of P 2 i(t) in I. 

Pzi = -l + a2i(P2i -Pw) 

< -1 + aaiPai - 021 , Vt 6 [to, T). 

<2i3 

Compare P 21 (^) with plJ (t), where (t) is the solution to the following differential 

equation: 

1 _ g“13(S-2’) 

pZ{t) = -i + « 2 .[pS(t) ], vTim^o. 

rttn 


1 _ pO-nit-T) 

i.e. P 21 W = + 


ai3 

_ g“13(t-2’) g“2l(t— 2’) _ g“13(^~2’) 


+ 


021 <213 021 — <213 

From the mequality, 

P2i(^) < a2i(P2i ^ [^o,T) 

and the boimdary condition P 2 i(^) “ P* 2 i{T) = 0 , it can be argued that 

P21W > Pili^)^ vte[to,T) 

1 _ ga2i(l-r) 1 _ pai3(t-r) gan{l-T) _ ^au(t-T) 

le. P5,(t) > + + ^ ^ Vte[to,T). 

021 ai3 '^21 ~ “13 

We have already proved (in the proof for Theorem 4 3 3) m Sechon 4 3 that durmg 


<^21-^13 


IS 


an mterval endmg with T, the function ^ ^ *^^3 !■ “ 

greater than p^(t) = 

Hence p 2 i (0 i® greater than p^(t)/ m an interval endmg with T. Therefore 021 (t) 
can not be idenhcally equal to unity durmg [toj T] For the network to be operatmg 
m EFT mode durmg an interval, n 2 i(^) equal to unity throughout that 

mterval Thus EFT mode of operahon is ruled out m a termmatmg interval. 

We can rule out the modes EPL, EFT and EPS m a termmal regime from the 
followmg considerations. 

EPL: 

The costate variables Pi 3 (t)/ P 2 i (0 Ph(^) follows 

= -l + ai3Pu(i),Pi3(7’) = 0. 
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Puii) = 
Pziii) = 
= 


1 _ gai3(i-T) 

^13 

1 _ g“ 2 l(i-r) ^ _ gai3(i-r) ga 2 i(t-T) _ ^ 013 ( 4 — T) 

021 (^13 (021 — <213) 

1 _ g“23(t-r) 

023 


Link (2,1) could possibly operate m the partial mode only if P 2 i{t) and p'^{t) are 
identically equal over an mterval. But in an mterval endmg with T, Piiit) as given 
by the above expression is greater than p^(t) (we proved this result m the proof of 
Theorem 4.3 3) Hence link (2,1) can not be m Partial mode m a termmal mterval 
and thus EPL mode of operation is ruled out m a termmal regime. 


EPS: 


Pn = 
Piiii) = 
Pn = 


-1 + aniPn “ Pn) and p\ 2 {T) = 0 

_ gaiz{t-T) I _ ^anit-T) gai2(t-T) _ Qai2,{t-T) 

012 <223 (<212 ~ ^23) 

-1 andp^ 3 (r) = 0. 


Pn { t )^{ T - t ) > fnit ) 

Hence ai 2 (i) = 1 

Therefore Imk (1,2) can not be operating m Empty mode. 

EPT: 

Since link (1,3) is operating m the transition mode, xisi < Xi 3 {t) < xisc and conse- 
quently || < 013 . 

^^3 < — l + ni3Pi3) Pni'^)^^ 

Therefore pl^it) > — 

P 21 = -l + f22l(P21 “i^is) 

1 _ ga,3(t-n) 

< —1 -f- 02l(P21 ~ ) 

Oi3 

As argued out earher (m provmg that EFT is ruled out in a termmal regime) the 
function p^i(t) which satisfies the above mequality is such that 

1 _ ga2l(‘-2’) 1 _ g“l3(<-2’) gaiiit-T) _ gai3{t-T) 

H — H 

<2i3 


P2i(i) > 


O21 


<221 <213 
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Since the function on the right side of the above equation is greater than m an 

interval ending with T, the routing variable has to be zero Thus EPT mode 
of operation m which 0:21 (^) non-zero is ruled out in an mterval endmg with T. 

From the above discussion, the followmg conclusions can be drawn on the na- 
ture of the optimal routmg strategy for networks with link ( 1 , 3 ) of finite channel 
capacity C 13 . 


• The routmg variable 013 (t) takes the values 0,1 or 

• Durmg no mterval of the network operation, packets are forwarded onto both 
the links ( 1 , 2 ) and ( 2 , 1 ) simultaneously (Loop-free property) 

• The network operation ends m only one of the followmg four possible modes 

(a) FES : q;i 2 = 1 , 021 = 0/ Link (1,3) in saturation 

(b) PET : qi 2 = 1 - x T Snx2^ ' ^21 = 0, x^3{t) = xus- 

(c) EET : 0:12 = 0, 021 = 0, a;i 3 (t) = 0 : 13 *. 

(d) EEL : On = 0, 021 = 0/ hnk (1,3) m Imear mode 

The examples presented below are cases wherem the network operation ends m 
one of the above modes 

4.4.4 Numerical Examples 

Consider a network with the followmg link parameters. 

ai 2 = 01 , C 12 = 00 . 
ai 3 = 0 5, Ci3 = 10. 

021 = 01 , C 21 = 00 
023 = 0 4, C 2 } = 00 

Assume the network operation to be for a duration of 10 units, i.e T= 10 umts. 
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Figure 4.10 State variables as functions of time for Example 4 4.2 1 
Example 4.4.2.1 : 

For the following choice of the mihal buffer occupancies and the mput traffic Xi{t) 
and X 2 {t) the network operation ends m FES mode 

•i’i3(0) = 150, a;i2(0) = 0:21 (0) = X23(0) = 0. 

Ai = A 2 = 10 

The state variables (buffer occupancies) under the optimal routmg strategy are • 

2 ^ 13(0 = 150 — lOf, 
xi2{t) = 100[l-e-°^‘] 

3:21 (i) = 0 

X23{t) = 50[l-e-°^‘]-33 33[e-'’^'-e-°'^‘] 

The optimal routmg strategy for this case is given as: 

aisit) = 0, a2i(f) = 0, Vt e [0, 10] 

Remark 4.4.1 It can be easily verified that the ophmal routmg strategy is as given 
above since the costate variables satisfy the followmg relationships- 


Pn{t) = 10 -t 

Pn{t) = 10[1 - e° + 2 5[1 - e° + 3 33[e° - e® 
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P21 (i) = 10 -t 

P23it) = 2 5[1 

Pi2(0 < Pi3(^)/ Vi € [0, 10] Hence Q;i3(i) = 0. 

Pziit) > P23(0/ Vi G [0, 10] Hence Q!2 i ( i) = 0 

Note that this example pertams to a situation wherein the initial buffer occupancy 
of Imk (1,3) IS large enough to ensure that packets can be drawn out at the maximum 
rate (equal to the charmel capacity C13) for the entire duration of network operation 
even when no new packets are routed onto it. 

Example 4.4.2.2 : 

For the following choice of initial buffer occupancies and the mput traffic, the 
network operation ends m PET mode. 

^13(0) = 2:12(0) = X2i(0) = 2:23(0) = 0. 

Ai = A2 = 15 

The buffer occupancies for this case are as follows 
During the interval [0, 2 197], 

xi3(i) = 30(l-e-«5‘) 

2:12(0 = 0 
2:21(0 = 0 

2:23(0 = 37 5(1 - 6-° ^0 

Durmg the mterval (2 197, 10] 

2:13 (i) = 20 

2:12(0 = 5 O(l-e “°^^‘“^^®^0 
2:21(0 = 0 

a'23(ij = 21 9145e-°^(^-'^^'> +50(1 - - 16 66(6-°'^^-'''''^ - 

The optimal routmg strategy for this case is given as: 

ai3(i) = 1, Vi G [0,2 197] 
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Figure 411 State variables as functions of time for Example 4 4 2 2 

ai3(t} = 10/15, Vt€ [2197,10] 

<^ 23(0 “ Vi S [0, 10] 

Remark 4.4.2 We shall argue in the next sechon that the above values of the 
routmg variables correspond to the optimal routmg strategy 
Example 4.4.2.3 : 

For the followmg choice of the inibal buffer occupancies and the mput traffic, the 
network operation ends in EET mode 

a;i3(0) = 20, 2:12(0) = 2:21(0) = 2:23(0) = 0. 

Ai = A2 = 10. 

The buffer occupancies are given as: 

2:13 (i) = 20 
2:12 (i) = O 
2:21 (i) = 0 

x^(t) = 25(l-e-°^‘) Vi €[0,10] 

The optimal routmg strategy is given as 

o:i 2 ('^} = 0, 021 (i) = 1 Vi e [0. 10] 
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Figure 4 12 State variables as functions of time for Example 4 4.2 3 . 

Remark 4.4.3 In the next section, we shall argue that the above is the optimal 
routmg strategy. 

Example 4.4.2.4 : 

Consider the case wherein the initial buffer occupancies are all zero and the mput 
traffic Ai = A 2 = 10. 

The buffer occupancies for the interval [0,10] are the followmg 

= 20(l-e-°=‘) 

X\2{t) = 0 

X2i{t) = 0 

X2z{t) = 25(l-e-°^‘) 

The optimal routing strategy is given as: 

ceisit) = Ol'23{t) = 1 Vf G [0, 10] 

Remark 4.4.4 It can be seen that the network operates m EEL mode (with the 
above values for the routing variables) for the entire duration [0, 10] smce the costate 
variables satisfy the following relationships 

Pu[t) = 10(1 - 6° + 2.5(1 - + 3 33(e°<‘-'°> - e° 
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Figure 4 13. State variables as functions of time for Example 4 4.2.4 
p,,{t) = 

Piiit) > Puit) Vt€[0,10]. 

P2i{t) = 10(1 - + 2 

P2s{t) = 2 5[l-e°^^^-'°)] 

P2l(t) > P23if) Vf6[0,10]. 


4.5 The Optimal and Suboptimal Routing Strategies 
Under Certain Restrictions on the Link Parameters 

Our analysis in the previous section assumed no restrictions on the link parameters 
of the network, on the initial buffer occupancies and on the input loads Ai(t) and 
Xzit) We proved some mterestmg properties of the optimal routmg algorithm 
without explicitly obtaining the solutions for the routmg variables. In this section, 
we specify the optimal routmg variables for networks m which the link parameters 
ai 2 , ai 3 . a.: and satisfy any of the three conditions of Theorem 4 3.2 stated 
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earlier. The implication of this assumption (regardmg the link parameters) is that if 
all the Imks of the network were of infimte channel capacity (and hence the network 
operates is m the Imear mode for the entire duration [ 0 , T]) then the optimal routmg 
strategy would be a regime 4 routmg (i.e a direct routing) over [ 0 , T] . In the analysis 
that follows, we assume that the network operation starts m the linear mode 
The arguments used m this section for obtammg the equations for the optimal 
routing variables are analogous to the ones used m the case of the two-node net- 
work which we considered in Chapter 3 The optimal routmg strategy is first 
obtained for the cases wherem the total traffic (Ai(f) -t 021X21 (f)) arnvmg at node 1 
has a single positive crossmg over the value equal to C13 The arguments are then 
extended to the case of any arbitrary load patterns. We derive a set of equations 
(in terms of the link parameters and the traffic), the solution to which specifies the 
optimal routing strategy We also propose a suboptimal algorithm and provide 
some illustrative examples wherein the performances of the optimal and subopti- 
mal algorithms are compared 

Assumptions: 

Assumption 4 . 5.1 The link parameters au, ai 3 , 021 and 033 of the network satisfy 
any of the following sets of conditions- 

(I) ^23 > 0-13 > ai2 

( II ) ai3 > a23 > 021 

(lii) 013 > 012 and 033 > 021- 

Assumption 4 . 5.2 The network operation starts m the Imear mode le x^ 3 ( 0 ) < xisi 

(m the limiting case of r tending to zero, xi3(0) < xis^). 

Lemma 4.5.1 The functions andpt^^{t) are non-negative in [0 T]. 

Proof : It can be argued as follows that the assumption of the existence of an 
mterval durmg which either Pizi^) or P2i(^) negative leads to a violation of the 
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transversality condition 

The dynamics of pl 2 {t) and P 2 i(t) are given as. 

— — 1 + ^ 12^12 - (inoclxPn — 

P2\{i) = -1 + a2iP2i - - o.i\(^nPi3 

Let Jo = [to, ti] where 0 < to < < T be an interval such that Pi 2 {t) <0, Vt 6 Iq. 

Since pjg (t) IS positive m the interval [0, T), p^^it) is less than pjg (t) in Iq 
We have already proved m the previous sectaon that there exists no interval durmg 
which p[2(0 IS less than p^ 3 (t) andp$i(t) is less than p^(t) (see the proof of Theorem 
4 4 2 m the subsection Loop-free property ) Therefore in the mterval Iq, p^^it) has 
to be greater than P23(0- Hence p^it) > 0,Vt € /o 

Therefore, p ^2 = -1 + ai 2 (p’i 2 - Pa)> 

< -1, Vt 6 Jo. 

Pi2(i) IS therefore a monotonically decreasmg function m Iq. Hence at t = fj, 
Pi 2 (^i) < Pi 2 (^o) < 0. Since the function Puit) is contmuous m the entire mter\’-al 
[0, T], it can be concluded that Jo is followed by an mterval Ji in which Pi 2 (t) < 0 
Then the above arguments (that p{ 2 (i) is monotonically decreasmg and negative) 
can be extended to Ji, and it can be concluded that Ji, m turn, is followed by an 
interval m which the the function pi 2 (i) contmues to be negative and monotonically 
decreasmg. Extension of the above arguments results m the condition Pi 2 (t) < 0, 
Vt e [io, T]. Since this violates the transversality condition at t = T, the assumption 
of the existence of an mterval Jo durmg which Pi 2 (i) < 0 is mcorrect 
An analogous reasonmg on P 2 i (t) can be used to prove that there exists no interval 
durmg which P2i(0 < 0 


□ 

Theorem 4.5.1 If the link parameters satisfy any of the three conditions of Assumption 
4 51, the traffic arriving at node 2 is never routed onto the link (2,1) for the entire duration 
of network operation 
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Proof : By Lemma 4 5 1, the functions p[ 2 {t) and are non-negative in [0 T] 
We have already established (m the proof of Lemma 4.4.1) thatpi[ 3 (t) and p^{t) are 
non-negative m [0, T]. 

ThuS/ P 21 = -1-1- 021^21 ~ ^210:^2^12 ~ <^210:13^13 

< -l + a2ip^i, vte[0,r] 


From the mequality P 2 iit) < — 1 H- ajiphit) Vf 6 [0, T] , and the boundary condition 
P 2 i(^) = argued that 


fziit) > ^ ^,vte[0,T) 


^21 


Under conditions (ii) and (iii) of Assumption 4 5 1, a 23 > <221 


(1 — 

Hence p^^it) < Vte[0,T) 

021 

< P2iW> vt€[o,r) 

= 0, vte[o,T) 


We have, 


Therefore Pi 2 (^) ^ 


p’i2 < -l + ai2P’i2> andp5;2(^) = 0 

(1 _ e“i2(‘-U) 


ai2 


,VfElO,T]. 


Under condition ( 1 ) of Assumption 4.5 1 , 023 > <212 023 > flis- 

Therefore 


Furthermore 


Hence 


Pl3 


(1 _ 

Pa(<) < ^ ^ £ pIzI') 

^ ^ ai2 


— -f- /^ Pis < — 1 + 0,l3Pl3}^t ^ [0i 


dx'' 


13 


Pl3(^) > ^ ^ 

<213 


We know that phit) = -1 + a2ip5i - a 2 iai 2 Pi 2 “ ^ 210^^13 
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Since both Pi 2 {t) and p{ 2 ,{t) are greater thanp^(t), 


Pni't) 


a2i{t) 


< — 1 + 021^21 — Vt G [0, T) 

(1 _ e°2i(i-r)j ^ (1 _ ga23(t-r )) _ e“23{t-r)) 

*^21 023 (021 — 023 ) 

> € [0,T) 

= 0 Vt G [0, T] 


, viG [0,r). 


Hence under any of the three condiPons (i), (ii) and (lii) of Assumption 4.5 1, 
= 0. 


Comments : 


□ 


• Under any of the three sets of conditions of Assumption 4 5.1, P2i(0 the 
linear case (i.e corresponding to the situation wherein C13 = 00) as given by 
the expression 


1 — g°'2lit—T) __ ^aisit-T) /'ga2l(f-n) _ QO-isit-T)^ 

P2l{i) = 1 1 7 7 

O 21 Oi3 (021 “ Qisj 

is greater than P 23 .{t), Vt G [0, T), and consequently Q;2i(t) = 0. In other 
words, the traffic arriving at node 2 is never routed through the alternate 
path consisting of links (2,1) and (1,3) If we now replace link (1,3) with one 
of finite charmel capacity (but of the same Imk parameter 013), it is mtuitively 
jushfiable to assume that m such a network too, routmg of packets arrivmg 
at node 2 along the alternate path (2,1) and (1,3) would result m a suboptimal 
performance. Thus the above theorem is in agreement with our mtuihon. 


• Smce a^i(t) = 0, Vt G [0,T], the equation for p^ 2 (’^) is 


P 12 

Therefore ^(2(0 


— 1 + ai2Pi2(^) ~ '^i2P^(^) Pui'^) ~ 0- 

1 _ ga-lz{t-T) 2 — 

+ + ^ ...(D) 

ai2 ^23 (fll2 - ^23) 


We state below a lemma which will be used m the arguments that follow. 
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Lemma 4.5.2 ^ ^ ^hen the solution to the equation pu = -l + anpi 3 with 

an initial condition pisito) which satisfies the following condition 


Pisik) > Pu{to) 


1 — g^-uho—T) ^ _ Qa 23 {tQ-T) rg<Il 2 (* 0 — _ g°- 23 {lo—T)\ 

-j“ — 1- ^ 

012 023 ( 0 i 2 — 023 ) 


(where to < T) is such that 

1 _ Q<^u{t-T) ^ _ ga 23(£-T’) gai2(£-T) _ ga-a{t-T) 

P\s{i) > Pi2{i) = ;; 1 ;; 1 ;;; > Vi g (to,T] 

O12 O23 a \2 — 023 

Proof : It IS easily verified that pnit) as given by the above expression is the 

solution to the following differential equation- 

\ _ g“23{£-T’) 


P 12 = — 1 + Oi2Pl2 — O 12 - 


O 23 


With the boundary condition p\i[T) = 0 We also note that 

1 _ g“n(£-7’) 

Pii{t) > ^ ViG[io,T] 

012 

If i < — H- — , then -L < — and therefore > an. Similarly ais > 023 

ai3 — ai2 023 “13 “12 

We can prove that Pisit) is positive m [to, T] as follows 

Compare pn{t) with the function pl^{t) where Pn{t) is the solution to the differential 
equation given below 


Plsii) = -l + ai3Pt3(i)i pUT) = 0 
1 _ 


i.e. pn{t) 


013 


Since an > an, 


1 _ g“12(£-r) 

plaW < — Vt€[0,T) 

< pi2WViG[o,r) 


In particular, p^ 3 (fo) < Pi 2 (fo) Thus 

Pl3(^o) > Pizih) > Pl3(^o) 

The solution to the differential equation 

P13(0"K3 = Oi3(pi3(t) -Pl3(^)) 
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with the initial condition (pi3(io)-pi3 (to)) > 0,suchthat (pi3(t)-p];3(t)) > 0,Vt > to- 
Since p^slt) > 0, Vt e [to, T), it follows thatpi3(t) > 0, Vt € [to, T]. This proves that 
the function pi 3 (t) is positive in [to,T]. 

Thus under the stated inequality of the lemma, we have the followmg relation- 
ships. 


Therefore, 


Pl3 = 
> 

Pl2 = 
< 

P13-P12 > 


— 1 + ai3Pi3 

— 1 + ai2pi3 smce pi3(t) is positive. 

— 1 + ai2Pl2 — CLU 

0.23 

— 1 + ai2Pl2 

on(pi3 £ [io,T] 


From the mitial condition pi3(to) - pnito) > 0, and from the above inequality, it 
follows that pisit) > Pn{t), Vt e [to, T] 

Hence the lemma. 


□ 


Theorem 4.5.2 The routing variable ai3(t) (in the limiting case of r tending to zero) is 
either lor e [0,T\ 

Proof : We prove that for the control problem correspondmg to the limitmg case 
of r tending to zero, there exists no mterval I = [to, h] durmg which Pi3(t) > phit)- 
Letpl3(t) > p\2{t)i Vt e / = [to, ti]. 

Then Q:3(t) s 0, Vi e I, and i;, = -/faW,) Therefore 43(() is a monotonically 
decreasing function m I. 

It can be mferred that ^t € I from the followmg arguments. 

lixUt) > xrsJotanyU,thenxUt) > J^iscWf e M (smce 2:^3 (t) is monotonicaUy 
decreasing in I) Consider the followmg set of differential equahons m the state 
variable x\3(t) and the costate variable p'i3(t) m the mterval [0, t,]. 


^{3 

P^3 


/l3(-^13) + «13(^)(’^l(^) + “2 i4i) 
Ci/r3(^l 


-1 + 


dx 


o’’ 

Pl3 
13 
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where = 0 if p{2,{t) > p\2{t) (which is given by the Equation (D) ). It is easy to 

verify that if the boundary conditions are such that 

, then the solution to and pl^it) are given as 

^13(0 = ^13(^1) + Oi3(ti — t) where > xisc 
Pl3(0 = Phitr) + {U - 1) 

Thus at f = 0 , we get a;^3(0) > xi3c + Ci3(t,) which violates the Assumption 4 5 2 
that the network operation starts in the linear mode Therefore x^^it) has to be less 
than xi3c during [to, U]. 

It can also be concluded that 3:i3(t) is greater than 3:13;, \/t e I from the followmg 
arguments. 

If x[3{t) < xi3i for some t, G I, then x\;i{t) < Xi3i, Vt > t, and p^3(t) = -1 + 013^^3, 
Vt € [U, fi] Note that the Imk parameters ai3, an and a23 satisfy the condition of 
Lemma 4 5 2 Therefore the function ^^3 (t) is greater than p[2{t) m the entire mterval 
[/,, T] Since this results in the violation of the transversality condition p\3{T) = 0 , 
it can be concluded that durmg the mterval I, x\3{t) > x^zi. 

Thus, XX31 < x'l^it) < Xi3c . 

Therefore 


^13 < -<^ 13 X 131 , Vt G I. 

which implies that xl^iti) — xl^(to) < —cii3Xi3i{ti — to) 

i.e 2:^3 (to )— 2:^3 (ti) > <2132^131(^1 ~ ^o) 


Smce (.r^3(to) - 2;i3(ti)) < xisc - 2:131, (both a:^3(to) and 3:i3(ti) he m the mterval 
[•t'lsi, 2:13c]) we get the mequality- 

0 < (f. - (o) < 

In the limiting case as r tends to zero, both a: 13c and xi3i tend to xis^. Hence the 
length of the mterval I which is equal to {h - to) also tends to zero In other 


words, correspondmg to the control problem corresponding to the limiting case of 
r tending to zero, there doesNt exist an interval durmg which pi3(t) > P\i{t] 
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Figure 4.14; Load pattern which ends with a value greater than Cis 

We have already established that if pi 3 (i;) is less than pn{t), then 0 !i 3 (t) equals 
unity and if pi 3(0 is idenhcally equal to pnit) over an interval then ai 3 (t) equals 
Ai(f)+az% 2 i(t) interval. Thus the only possible values Q!i 3 (t) can take are 

1 Hence the theorem 

□ 

It can be easily argued that an interval of partial routing durmg which pni^) is 
identically equal to pi 3 {t) (and ai 3 {t) equals ) can not be preceeded by 

a saturation regime ( 7 J 13 = — 1 ) nor be followed by a linear regime (pis = — l+a^pis) 
if the Assumptions 4 5.1 and 4 5 2 are satisfied smce either of the above results m 
an interval during which pnit) > P\i{t). 

We now examme the nature of the ophmal routmg strategy for the case in which 
the total traffic arriving at node 1 (Ai(f) + anxnit)) has a smgle positive crossing 
over a value equal to 013 as shown in Figure 4 14 and Figure 4.15 
Note: The arguments that follow are applicable to the case of r tending to zero 
only 

As proved m the previous section, the network operation can end only m one 
of the four modes . FES, PET, EET and EEL. For the network operation to end in 
FES, It is necessary (and sufficient) that a:i 3 ( 0 ) > xu. + CifT Since this is not the 
case as per the Assumphon 4 5 2, FES as a termmal mode is ruled out 

A necessary condition for the network to end m PET or EET is that Ai [t) + 021 X 21 (^) 
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Load 



Figure 4.15 Load Ai {t) + azixzi {t) with a single positive crossing over the value Cis 


IS greater than or equal to C 13 , Vt e [io, T] for some 0 < to <T For loads shown in 
Figure 4 15 such is not the case and therefore the network operahon ends m EEL 
mode. 

Consider loads which end with a value greater than C 13 as shown m Figure 4 14 
By the Theorem 4 5.2 the routing variable o;i 3 {t) is either unity or Xi(t) ' +a;;xn 
xi 3 (t) = at some instant to > ta (where ta is as shown m the Figure 4.14) then 


aioit) = 




Xi{t) +■ 0121 2^21 (t) 


for [to,T]. 


Note This follows from the fact that the network operation can not end m FES 
mode 

Therefore the optimal routing strategy for loads (Ai(f) + aziXziit)) which end 
with a value greater than C 13 , is 


= 1 Fort€[0,ti] 
Cl3 

\l{t) + CL2l‘^2l{t) 
a-izit) = 1 - Q:i3(i) 


for t e [ts,T] 


and 0:21 (^) = 


0:23(0 = 1 


where ts is the first mstant at which x^it) reaches the value 2 : 135 . 
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4.5.1 Optimal routing strategy: Implementation 

We have already established in Theorem 4 5.2 that either the entire traffic at node 1 
IS routed onto the link (1,3) or there is a partial routing of x^(^t)+a^^x 2 (h 
By Theorem 4.5.1 the routmg variable Q; 2 i(t) is zero for the entire mterval of network 
operation. Therefore the optimal routmg strategy for this network under the stated 
Assumptions 4 51 and 4.5 2 can be implemented by the following algonthm- 
Step I: 

Check if ai 3 (f) = 1, V;t G [0, T] is the optimal routmg strategy by the following 
steps 

(i) Integrate the equations x-13 = -/^(ris) + Ai(i) + 021X21 (t), where X2i(t) = 
^2i(0)e“®^'^(Q;2i(i) = 0 and therefore X21 = —021X21)/ with the imhal condition 
Xi3(0). Obtamxi3(f) and G [0,r]. 


( 11 ) Check if the following mequality holds true 

1 ^ _ Qa-!z{l-T) QO’izit-T) _ 

Pl3(i) < ?>12(0 = \ 1 7 ^ 

012 023 (ai 2 - <123) 

If the inequality is satisfied for all t G [0, T] then oi\ 3 {t) = 1 is the optimal 
routmg strategy. 


Step II. 

If the inequality- in step I ( 11 ) is violated for some t G [0, T], there are intervals of 
partial routing durmg which 

Cl3 

OC\3{t) - Xi{t) + a2iX2l{t) 

We shall investigate a procedure to specify the intervals of partial routing if they 
exist Consider the case where in the total load arrivmg at node 1 has a smgle 
positive crossing over the value equal to C 13 . Since an interval of partial routing 
can't be preceded by a saturation regime nor be followed by a Imear regime it has 
to be [tsjti] where tg is the first mstant when xi 3 (t) = xi 3 s , and ti is such that 
ta<ts<ti< tb Here the instants ta and U as shown m the Figure 4.15 correspond 
to the mstants at which the load pattern crosses the value C 13 . 
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The optimal routing strategy is therefore given by 


ai 3 (t) 

= 1 

Vt G [0,ts]. 



Cx2 


Ai 

,{t) + <2212:21(0 


= 1 

Vf 6 (fi,T]. 

0^12(0 

= 1 - 

- 0:13(0 

Q;2i(0 

= 0 


023(0 

= 1 . 



vt € h]. 


Solution for ti: 

During [ts, tx], pu{t) = Pnit). 

Hence pi 3 (fi) = Pi 2 (h) = + ;; + r —r 

a\2 a23 {0,12 — 022) 

Atti,Xi 3 {ti) = Xi 3 s 

Let tx be the instant ( > tx) when xxz{t) reaches the value 0 : 13 *. During 

Xi3(t) > Xi3^. 


(Ai(t) + a2xX2i{t))dt = Cxsitl - tx) (4 32) 

Jti 

The dynamics of pi 3 (t) over [tx, is given by 

Pi3 = 

Hence for f € [fi, t^], 

Pi3{t) = Pi3(^i) - {t - ti) 

1 gai2(ti-T} _ QO'23{h~‘^) gO-llih—'X) _ Q0-23{h~T] 

— — — -j — H ^ ^ {t ti) 

ax 2 <^23 ^^12 ~ “23 

Over the interval [tx,T], link (1,3) is in the Imear mode Therefore 

I _ g“l3(^l-2’) 

Hence 

1 _ e“i 2 (‘i-D 1 _ e^23(h-T) go.i2{ti-T) _ ga23(ti-r) 


“12 


1 _ gOl3(t^-D 

+ — ^ 5 — «-*'> = 

(ai2 — 023) 


“23 
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Figure 4.16: Load X\{t) + anXzi (t) which has n positive crossings over the value C 13 
Solving the Equations (4 32) and (4 33) we get the instants h and 

Comments: The arguments used for obtammg Equations (4.32) and (4 33) are 
similar to those used for obtammg Equations (3 16) and (3 17) m the Chapter 3 for 
the two node case. 


4.5.2 Extension to arbitrary load patterns 

Consider a load pattern /\i(t) which is such that Xi{t) + 021 X 21 (t) has n positive 
crossmgs above the value C 13 as shown m the Figure 4.16 
Notes: 


(1) In the arguments that follow, we consider the case where r tends to zero 

(2) The analysis below is along similar lines as m the two-node case of Chapter 3. 


From our earlier discussion on the natifte of the Optimal Routing Strategy, it can 
be concluded that intervals of partial routing if they exist occur m the time mtervals 
durmg which Ai(f) + 021 X 21 is above the value C 13 Smce they are never preceded 
by saturation regimes nor followed by linear regimes, they must be of the type 
[i,. (.], fa], [i... (J where < 4 . and i.n are Tyrants at 

which xi(t) = xis- 
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The optimal routing strategy is specified as. 

c 

" m + (() ’ *■)' '=1' 2' 3, r. 

= 1 everywhere else 

dnit) = l-ai3{t), 

U2l(^) = 0 

Q!23(i^) = 1 

Let (ij, it*) be the saturation regime which follows the interval of partial routmg 
(smce an interval of partial routing can not be followed by a Imear regime, it has to 
be followed by a saturation regime during which a;i 3 {i) is greater than xus) 

At t = t*, = xisiQ = .1-13, for 1=1, 2, .. , n. 

Then 

t' {Xi{t)+a2iX2i{0)e-‘^^^^)dt = Ci3it:-Q, fori=l,2, .,n. (434) 

■It, 

Durmg the interval [t*, 013 (t) = 1 and the network operation is m the Imear 

mode. Therefore the dynamics of Imk (1,3) is given by 

Xi 3 = -ai3Xi3 + (Ai(f) 4- 0212:21 (t)), and x^it*) = Xiss- 


Therefore 

2:i3(its.+i) = e“i3‘(Ai(f) + a2iX2iit))dt 

1 

for 1 = 1 , 2, 3, — , (n-1). 

Since a;i 3 (i,,^J = 2 : 135 , we get the followmg (n-1) equations in i,/s and t*/s 
For 1 = 1, 2, . .., (n-1) 

j f e“’^^[Ai(i(:) -f- 0212 : 21 ( 0)6 (4.35) 

Ik 

Durmg the mterval [U, t*], a'i 3 (f) > Xi 3 s and therefore 
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PuiU) 

i.e. {t* — U) + 


Pi3(t:) + (K - i.) 

_ ga23(t.-'r) e^n{t,~T) __ a22{t,~T) 

— - + ^ 

^12 023 (ai2 - 023) 

(4.36) 


Over [fj , is.+i]/' lirvk (1,3) operates in the linear mode and therefore the dynamics of 
Pi 3 (t) IS given as 


Pi3 = -1 + ai3Pi3 


Since A3(i^.+i) 


pMK) 


Pi 2 (ts,+i), we get 




1 _ 

^13 


Substituting the above m the Equation (4 36), we get the following n equations 
For 1 = 1, 2, , n 


fl.12 a23 

(ttl2~«23) 


{<; - '.) + 

’ “p 

a\2 0.23 

( 012 - 023 ) 


(4 37) 


To solve for ti, ts,, ti, t\, .. tn, i* , we have to solve the (3n-l) Equations (4.34), 

(4 35), and (4.37) given above. 

Analytical solutions to the above set of equations are not easy to obtam. Further- 
more, the specification of the optimal routmg strategy requires the knowledge of 
the mput load Ai(f) for the entire duration [0, T] Since this implies that an on- 
line implementation of the routmg strategy cannot be obtamed, we propose the 
followmg suboptimal strategy 


4.5.3 Suboptimal Algorithm 

Since the maximum rate at which Imk (1,3) can be operated is its channel capacity 
Ci 3 which is achieved when the buffer occupancy of this link reaches a value equal 
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to xiss/ It would be advantageous to route the overflow traffic via link (1,2) and (2,3) 
to the destination node 3, once the bufler occupancy of link (1,3) reaches the value 
xi 3 . Based on this intuition (which was also the basis for the suboptimal algorithm 
for the two-node case of Chapter 3) we consider the following suboptimal strategy 


ai 3 {t) = 1 for f€[0,fsi] 

Ai(f) + aLxa(()^“ 

= 1 everywhere else 


and auit) = 1 - Q;i 3 (t) 

a 2 i{t) = 0 over[0,r] 
a 23 {t) = lover[0,r]. 


For some typical load patterns, the performances of the optimal strategy and the 
suboptimal strategy are compared m the examples given below. 


4-5.4 Numerical Examples 

Consider a network with parameters = 0 1, = 0 5, azi = 0 1, a 23 = 0 5, and 

Ci 3 = 5 0, with initial buffer occupancies j:i 3(0) = .ri2(0) = X2i(0) = X23(0) = 0 
Let the network operation be for a time span [0, 10] The buffer occupancies, rout- 
mg variables and the performances for the optimal and the suboptimal strategies 
(which is proposed above) are given below for each of the example. 

Note : 

In each of the five examples given below, we assume that the input traffic at node 
2 ( 1 e. Xii’t ) ) IS a constant equal to 10 for the entire duration of network operation. 
Example 4.5.4.1 : 

The input traffic at node 1 .i e Ai (t) is 10 for the entire duration [0, 10] as shown m 
Figure 4 17. For this case the optimal and the suboptimal strategies are identical. 
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Figure 4.17 Load Xi{t) for Example 4 5 4.1 


Table 4 1 Optimal and suboptimal routmg strategies for Example 4 5 4.1. 


Optimal Strategy 

Suboptimal Strategy 

aizlt) = 1 for i e [0, 1 3863] 
= 0 5, ^ e (1 3863, 10] 

o:i 3 {t) = 1 for i G [0, 1 3863] 
= 0 5, ^ G (1 3863. 10] 

n-'23(0 = 1 for t € [0, 10] 

a'23(U ~ 1 ^ ^ [O’ 10] 

= 375 00'126 

'Jiubopt = 375 00126 



Figure 4.18 Buffer occupancies under the optimal and suboptimal strategies for 
Example 4 5 41. 
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The load pattern Xi{t) is as shown below: 


10 

Xi{t) 

3 

0 

0 2 5 5 7 5 10 



time 

Figure 4.19: Load Ai(i;) for Example 4.5 4 2 


Table 4 2. Optimal and suboptimal routmg strategies for Example 4.5.4 2. 


Optimal Strategy 

Suboptimal Strategy 

axsit) = 1 for i E [0, 3 4046] 

= 0 5, t e (3.4046. 6.852491] 
=lfort E (6 852491.10] 

Q;i 3 (i) = 1 for t E [0, 3 4046] 
=0 5,t 6 (3 4046.7 5] 

=1 e (7 5, 10] 

a-jsit) = 1 for t E [0. 10] 

a 23 (t) = 1 fort E [0,10] 

= 330 24194 

1 = 334 77986 
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Figure 4.20 Buffer occupancies under the optimal strategy for Example 4 5.4.2. 



time 


Figure 4.21 Buffer occupancies under the suboptimal strategy for Example 4.5 4 2. 
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The load pattern is as shown below: 


6 

Xx{t) 

4 


0 


0 2 5 5 7 5 10 


time 

Figure 4 22. Load Ai(t) for Example 4 5 4.3. 


Table 4 3- Optimal and subophmal routmg strategies for Example 4 5 4 


Ophmal Strategy 

Suboptimal Strategy 

ai 3 (t) = 1 for f € [0,4 79228] 

= 5/6,te (4 79228. 6 1617] 
= l,te ^6 1617, 10] 

ms (f) = 1 fort G [0,4 79228] 
= 5/6,tG (4 79228.75] 

= l,tG (75,10] 

023 ^) = 1, for f G [0. 10] 

023 ( 4 ) = 1, for t G [0, 10] 

= 249 01467 

Jsubopt = 250 6276 
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Figure 4.23: Buffer occupancies under the optimal strategy for Example 4.5.4.3 



Figure 4 24 Buffer occupancies under the suboptimal strategy for Example 4 5.4 3 
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Example 4. 5.4.4 : 

The load pattern Ai (t) is as shown below 


T 


T 


8 - I 1 I 1 

AlW 

3 1 I 1 I 

0 I ^ ^ ^ ^ 1 

0 2 4 6 8 10 

time 

Figure 4 25 Load Ai (t) for Example 45 44 


Table 4.4 Optimal and suboptimal routing strategies for Example 4 5 4.4. 


Optimal Strategy 

Suboptimal Strategy 

= 1 for t G [0, 6 5060493] 

= 5/8 over (6 5060, 6 710] 

= 1 over (6 710, 10] 

ai 3 {t) = 1 for f G [0,3 4205455] 

= 5/8,fG (3 4205455,4] 

=1 ,tG (4,6 70330] 

=5/8,f G (6 70330,8] 

=l,f G (8,10] 

ctziit) =1, fort G 0,10] 

= Lfort G 0.10] 

249 43406 

/,*.. = 255 5198 
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Figure 4.26 Buffer occupancies under the optimal strategy for Example 4 5 4 4. 



Figure 4 27 Buffer occupancies under the suboptimal strategy for Example 4 o 4 4 
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The load pattern Xi{t) is as shown below 


T 


10 

Ai(i) 

4 


0 2 4 6 8 10 

time 


Figure 4 28; Load Xi{t) for Example 4.5.4 5 


Table 4 5 Optimal and suboptimal routmg strategies for Example 4 5.4 5. 


Optimal Strategy 

Suboptimal Strategy 

0 ^ 13(0 ~ 1 t G [0, 2 8033205] 

= 05,te (2.8033205,3655] 

= 1 for t €. {3 655, 6 0507372] 

=0 5 for f € (6 0507372, 7 712575] 
= 1 fort €17 712575 10] 

0 : 13(0 = 1 for f G [0, 2 8033205_ 
=0 5, t G (2 8033205,4] 

=1, i G (4 6 2380962] 

=0 5, t G (6 2380962, 81 
= lfortGf8,10] 

ao 3 (t) = 1, for f G ]0, 10 

a-ait) = l,ioTt e 0,10 1 

= 291 52963 

Jsubopt = 295 02552 i 
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Figure 4 29 Buffer occupancies under the optimal strategy for Example 4 5.4 



Figure 4 30 Buffer occupancies under the suboptimal strategy for Example 4.5 
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Finally, we make the folio wmg observations regarding the nature of the optimal 
routmg strategy for the case where the network operation starts with an mitial 
buffer occupancy 0:13(0) > xiss If the mitial buffer occupancy xi3(0) is s t. 0:13(0) > 
Xi3s 4- C13T, then ocis{t) = 0, and 021 (f) = 0 is the optimal routing strategy for the 
entire duration [0, T]. For initial buffer occupancies 0:13(0) s t < 2:13(0) < xi 3 s + 
C 13 T, it can be easily argued that the network operation can not end m saturation 
mode and hence ends m either the Imear mode or the transition mode It can also 
be argued that if o:i3(it) at any mstant to is equal to Xis,, and if Ai(f) + a 2 iX 2 iit) > C13 
for all t > to, then ai3(f) = Y il ' iy+d^ixnit) ^ ^ analogy 

of all the above results with those of the two-node case of Chapter 3. 

4.6 Exponential Model : Some Observations 

Another interesting class of models which represents a flowout funchon that in- 
creases with increasing buffer occupancy and saturates at the channel capacity 
value of the associated link is the exponential model given below 


xi3 = -Ci3{l - e'^) + ni3(A3(t) -f C2i(l - (4.38) 

X12 = -^12(1 - + ai2(t)(Ai(t) + C2i(l - 6'“^’"^^/^=')) (4.39) 

X21 = -^21(1 - 4- a2i(t)(A2(t) -h ^^(l - (4.40) 

X23 = -C23(l - e’"^) 4- n23(A2(t) + Ci2(l - 6-“'^"'^/"^'^)) (4.41) 

Lmearised around the origm (i.e x^a, = 0), the flow out function as given by the 
above model equals that of the model considered earlier m Section 4 2 In other 
wordSy for small values of the buffer occupancies the value of the flow out function 
as given by the exponential model and the Imear model of the previous sections are 
nearly the same Similarly for large values of the buffer occupancies, the flowout is 
equal to the channel capacity of the Imk in both the cases For this class of models, 
consider an optimal routing strategy that mmimises the total buffer occupancy time 
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defined earlier as 

fT 

~ L ^^3 + 3^21 + Xzi)dt 

J 0 

It can be argued that the optimal routing strategy is a bang-bang type of control 
with followmg values for the routmg variables 

• If pi3(i) < Pnit), then 013(1;) = 1 

• If Pnit) > puit), then Q;i3(i) = 0. 

• If P23(^) < Piiit), then 023 (t) = 1. 

• If P23(t) > Piiit), then 023 (t) = 0 

The differential equations govemmg the dynamics of the costate variables are 


Pl3 = 

-1 + ai3e"“'3Xi3/Ci3p^^ 

(4 42) 

P 12 = 

-1 + - Q 21 P 21 - a23p23) 

(4 43) 

P 2 I = 

-1 + a2ie"'"^''=''/^^i(p2i - ai2Pi2 - cxisPn) 

(4.44) 

P 22 = 

-1 + a23e"““"“/^“P23 

(4 45) 


with the transversality conditions pniT) = PniT) = P 2 i{T) = PniT) = 0. 

The two-point boundary value problem in the state and costate variables was 
numerically integrated for various values of the link parameters and for various 
initial conditions as given in the Table 4.6 . This numerical experiment was repeated 
for various input load patterns given in Table 4 7 

From the above numerical mvestigations (examples of which are shown 
in the form of graphs as in Figure 4 31, Figure 4 32 and Figure 4 33), the following 
observations can be made regardmg the nature of the optimal routmg strategi' 


1 The optimal routing strategy has the loop-free property 

2 There is at most one mter regime switchmg 
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Table 4 6- Case 1: Load Xi{t) = X 2 {t) = 5 


No 

Link parameters 

Imbal Buffer 
Occupancies 

Optimal Strategy 

a 

ai 2 = 021 = 0 1 / 

ai3 = 023 = 0 5, 

On = C 21 = C 23 = 100000 
6-13 = 10 

X 12 = Xi 3 = 0 

X 21 = X 23 = 0 

ai3(t) = 1 

Q!23(f) = 1 

b 

same as above 

X 12 = X 21 = 10 

Xi3 = 50, X 23 = 10 

Mi) = 1 

Q!23(f) = 1 

c 

012 = O 2 I = 0 1 , 

01 3 = 023 = 0 5, 

C 12 = C 21 = 100000 

Ci 3 = 10, C 23 = 15 0 

X 12 = Xi3 = 0 

X 21 = X 23 = 0 

Mi) = 1 

<X23(f) = 1 

d 

same as above 

X 12 = x ’21 = 10 

xi3 = X 23 = 50 

Mi) = 1 

o:23(i) = 1 

e 

012 = 023 = 05 

013 = O 21 = 01 

C 12 = C 21 = Ci 3 = 100000 

^23 = 10 

X 12 = X 21 = 0 
.ri 3 = X 23 = 0 

Oisii) = 0, for f G [0, 3 6] 
o:i 3 (i) = 1, for t G (3 6, 10]. 
023(0 = 

f 

same as m 5 

X 12 = Xi 3 = X’ 2 i = 10 
E23 = 50 

0 : 13(0 = 1 

<023 (^) = 1 * 

g 

same as in 5 
except that C 13 = 10 

t'l 2 = I'U = 0 
m = .123 = 0 

0 : 13(0 = 0, for t G [0, 3 9] 
ai 3(0 = 1/ for f G (3 9, 10]. 

0:23 = 1 

h 

same as in 7 

X 12 = Xi3 = X 21 = 10 

X 23 = 50 

< 013(0 = f 
< 023(0 — f- 

1 

0.12 = 023 = 01 

021 =0 6 , ( 1 x 3 =05 

C 12 = C 21 = 100000 

^13 = 8 0 , (723 = 10 

ri2 = Xi3 = 0. 

r2i = X 23 = 0 

< 013(0 = 1- 

<021 (0 = 1 for t € [0, 3 0] 

<021 (0 = 0, for f G (3 0, 10] 

] 

same as m 9 

X 12 = X 21 = 5 

C 23 = 5, X 23 = 30 

0:13 (t) = 1 
<023 (^) = 1 


3 The system always ends in regime 4 ^ where direct paths are used at both the 
source nodes. 


^The definihons of the regimes are the same as in Section 4 2 
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Table 4 7 Load pattern for the various cases. 


Case 

Load Ai 

Load A 2 

2 

10 

10 

3 

15 

15 

4 

20 

20 

5 

25 

25 

6 

5 

25 

7 j 

10 

20 

8 

25 

5 

9 

20 

10 

10 

15 

20 



Q ^ I L 1 1 U. L ^ 1 1 

0123456789 10 


time 

Figure 4 31; Buffer occupancies for the case la. The network operates in regime 4 
for the entire duration. 

Comments: 

It was also observed that the numerical algorithm (which uses a Runge-Kutta- 
Merson method and a Newton iteration m a shootmg and matchmg technique 
[24]) used for solvmg the two point boundary value problem m the state and 
costate variables is sensitive to the choice of the mitial value of the costate vari- 
ables, particularly when the link capacities are small ( the links of the network 
operate m near saturahon mode). Convergence was found to be difficult to obtain 

under this situation 
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0123456789 10 

time 

Figure 4.32: Buffer occupancies for case Ig The network operation switches from 
regime 2 to regime 4 at = 3 9. 



time 

Figure 4 33 Buffer occupancies for case li. The network operation switches from 
regime 3 to regime 4 at = 3 0. 

The above numerical investigation raises certam mterestmg possibilities If the 
optimal routing strategy is characterised by the single-switchmg property with 
the terminal regime always bemg regime 4, then this property can be exploited m 
specifying the routmg strategy m the followmg manner. If we know the nature of 
switching ( i.e whether a regime 2 to regime 4 or a regime 3 to regime 4), then 
consider the performance of a suboptimal strategy m which this switchmg instant 
is an arbitrary value in [0. T] . By varying this switchmg mstant behveen 0 to T, and 
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fuiding tho instant at which, the performance index reaches the minimum (which 
can be done graphically), the switchmg instant correspondmg to the optimal strat- 
egy can be obtained The obvious advantage of this procedure is that it elimmates 
the need for solving the tedious two pomt boundary value problem m the state 
and costate variables Whether this property of single switching can be analytically 
proved and whether a necessary and sufficient condition which the link parameters 
and the mput traffic have to satisfy for a regime 2 to regime 4 (or regime 3 to regime 
4) switchmg to take place can be obtained, have not been mvestigated m this thesis 

4.7 Conclusions 

We investigated the problem of optimal traffic routmg m a simple network unit 
of three nodes m this chapter. As in the Chapter 3 of this thesis, our emphasis 
was on the model in which the flow out function ( for any link) depends linearly 
on the associated buffer occupancy and saturates at a value equal to the charmel 
capacity The optimal rouhng strategy was synthesised for the case where m all 
the links of the network have infmite channel capacities Under this situahon it 
ivas shown that the optimal strategy depends only on the topological parameters 
of the network and is independent of the mput traffic. This m turn allows for an 
on-line implementation scheme We also argued that the optimal routmg strategy 
is bang-bang m nature and has at the most one inter regime switchmg instant The 
optimal routmg strategy was shown to have the loop-free property also. 

We then relaxed the assumption that all links have mfmite channel capacities and 
considered the case wherein the direct Imk (1,3) is of fmite charmel capacity. The 
loop-free property was shown to hold good under this situation also However the 
rouhng strategy need not be bang-bang and there could be intervals of partial routing 
(as was shown m the examples cited) The network operafaon was shown to end 
always m one of the four modes FES, PET, EET and EEL 

We then considered networks (with finite C'13) m which the link parameters 
satisfy certain assumphons (as given by the condihons stated m Theorem 4.3 2) 
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The implicahon of these assiimptions being that if all the links were of infinite 
channel capacities, then the optimal strategy would be a direct routing for the 
entire duration of network operation Under the additional assumption that the 
initial buffer occupancy on link (1,3) is below the saturation value, we derived a set 
of equations (m terms of the Imk parameters and the input traffic), whose solution 
specify the optimal strategy Smce these equations are analytically difficult to solve 
and furthermore, need the knowledge of the mput traffic for the entire duration of 
operation ( thus an on-line implementation scheme is not possible), a suboptimal 
algorithm was proposed. The performances of the optimal and the suboptimal 
algorithm were compared in the case of some specific load patterns 

Finally we mvestigated the nature of the optimal routing strategy m the case of an 
exponential model From the numerical investigation conducted, we observed that 
the optimal routing strategy has the loop-free property and the smgle switchmg 
property as in the case of the linear model Furthermore, it was also observed that 
the network operation always ends in regime 4. Whether or not these properties 
can be analytically proved and whether they can be exploited m specifymg the 
optimal routing strategy by means of a simple procedure, are open issues which 
have not been addressed to in this thesis 



Chapter 5 


Optimal and Suboptimal Routing 
Strategies in Larger Networks 

5.1 Introduction 

The previous chapters have addressed to the issue of optimal/suboptimal traffic 
routing in two simple networks units, namely a two-node network m Chapter 3 
and a three-node network in Chapter 4 As mentioned m Chapter 1, large (commu- 
nication) networks can be viewed as being composed of simpler network uxuts and 
therefore the problem of synthesising optimal (or at least good suboptimal) routmg 
strategies for such large networks can be approached by considering routmg strate- 
gies which are locally optimal (or at least good suboptimal) for the network units 
which compose them. With this perspective we now mvestigate the problem of 
optimal routing in some network topologies which are composed of simpler units 
analysed earlier. An overview of what is attempted m this chapter is as follows' 

In Section 5 2, we study the nature of ophmal routmg strategy m a communi- 
cation network between a source and a destination pomt m which there is a set of 
two parallel links between every successive pair of nodes. External traffic amvmg 
at the source node and the transit nodes are to be routed to the destmation via 
the subsequent network units. This topology essentially is a concatenation of the 
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two-node network units considered m the Chapter 3. We first consider the general 
case wherein m such network units (of the total n which constitute the topology) 
have a link {ihe faster link of the two) of finite channel capacity (both the links of 
the remaining [n - m) units are assumed to be of infinite channel capacity) We 
show that m all the units which have both the links of infinite channel capacity, all 
the mcoming traffic is routed onto the faster link for the entire duration of network 
operation For those units which have a link of finite channel capacity either all 
the mcommg traffic is routed onto the faster link or there is a partial routing on 
this link During intervals of such partial routing, a fraction of the trahic equal to 
the ratio of the channel capacity to the total mcommg traffic is routed onto this 
Imk The properties of the optimal routing strategy which we proved m Chapter 
3 (as given by Theorems 3.3 1, 3 3 2 and 3 3 3) when these units were considered 
m isolation are shown to hold good even when they are considered m conjunction 
with other units For the case where only one unit has a Imk of fmite channel 
capacity (correspondmg to a choice of m equal to 1), we obtam a set of equations 
(m terms of the link parameters and the mput traffic to the network), which are 
to be solved to specify the optimal routing strategy. The specification of the op- 
timal strategy requires the knowledge of the load patterns for the entire duration 
of network operation. Since this necessitates an off-lme computation, an on-lme 
implementable suboptimal algorithm is suggested along the Imes as done for the 
individual network unit m Chapter 3. Examples are given wherem the performance 
of the optimal and suboptimal routing strategies are compared. 

In Section 5.3, we look at a topology composed of the three-node structure of 
Chapter 4. We had, m Chapter 4, synthesised the optimal routing strategy for the 
case wherem all the Imks of this network unit have mfmite charmel capacity. When 
all the links of this topology are of infinite channel capacity, the performances of 
the routing strategy which is globally optimal (m the sense of mmmimismg the total 
buffer occupancy time for the entire network) and the routing strategy synthesised 
from locally optimal ones are numerically compared for various choice of link 
p arameters. When one of the direct Imks of one unit is of fmite channel capacity, two 
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schemes of operating the network xmder the linear mode are considered The first 
one m which the Imear optimal strategy (which is globally optimal) is implemented 
on the network and excess traffic which drives the link of finite channel capacity 
mto saturation is rerouted onto a different unit m the topology. The second case 
corresponds to the implementation of locally optimal (linear) strategy with the 
excess traffic routed onto a different unit m the same layer of the topology The 
performance of these two schemes are compared for different link parameters of 
the network 

Fmally in Section 5 4, we consider a four-node hub network m which all the 
Imks are of infmite channel capacity. Topologically this network can be viewed as 
being composed of the three node network units which we considered m Chapter 
4, wherein adjacent units share a common direct Imk to the destmation It is shown 
that the optimal routmg strategy for this network unit has the loop-free property 
(This property was established for the constituent three-node network unit m the 
Chapter 4). The network operation always ends with a direct routmg of packets at 
all the three source nodes The conditions on the link parameters under which the 
optimal strategy for this network is the same as that synthesised from the locally 
optimal strategies for the constituent units, is arrived at When these conditions are 
violated, a suboptimal way of traffic routing m this network can be obtamed from 
the locally optimal strategies for the network units. We compare the performance of 
this algorithm with that of the optimal one in the case of some numencal examples 


5.2 Network topology of the two node network units 

Consider a network topology shown m Figure 5 1, m which the units i = 
1, 2, m have a link of fmite channel capacity and all the remainmg (n — mj units 
are of links of mfmite channel capacity The followmg assumptions are made in 
the analysis that follows' 

Assumptions : 

Assumption 5.1.1 The faster Imk m the /cj-th unit has a finite channel capacity 
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^12 022 aka an2 

Figure 5.1 A network topology of two node units 


equal to Cyt.i/ = 1, 2, m 

Assumption 5.1.2 The mihal buffer occupancies for the links with finite channel 
capacities do not exceed their saturation values, i.e 2:^,1 (0) < Xk^s for i = 1, 2, m 
Assumption 5.1.3 All the buffers are of infmite capacity and therefore packets are 
never rejected from any link 

As m the previous chapters the optimal routing strategy is defined as one which 
mmimises the total buffer occupancy time for the network in the entire duration of 
network operation. 

The system dynamics m this case is given by the followmg set of equations 

rcii = — <211.^11 + Qii(f)Ai(f) 

2:12 = —0.12^\2 + 

2^21 = ”<221^21 + 02i(f)(A2(f) + a\\X\i + 

2122 = ~0>2Z'^22 + <^22{'t) {^2{i) + < 211^111 + 

a:A,ii = -Aii(a;fcii) + 0!A,ii(f)(A;Li(f) + a(fej_i)2a:(fci_i)2) 

= -o.ka^ki2 + akaii) {hi {t) + a{ki-i)\^iki-i)i + a(ki-i)2X{ki-i)2) 

Xkml — + ^Iml W (^) + + a(fc.„-l)2a:(fcm-l)2) 

Xkm2 = —(2km2'^km2 + 0!fcm2(f ) (Afc„ (f ) + -l)ia:(l..„ -1)1 + <a(A,^_i)2a;(A,„-i)2j 

a^nl = -ania^'nl + Qnl(f)(An(f) + “(n-l)l-^(n-l)l + '^(n-l) 2 a;(n-l) 2 ) 
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where 

/fca(%-.i) = akjXkj 

= Cjt,i otherwise 

Because of the discontinuity of the function fk,iixk,i) at the point Xk,i = Xk,Uf the 
Maximum Prmciple is not directly applicable. We therefore approximate this func- 
tion by which is obtamed by drawmg an arc of radius r tangential to 

the portions ak^iXk.i and the constant Ck,i of the origmal function fK,i{xka) Corre- 
sponding to a value r, let the optimal state variables be denoted by 
x' 2 ^(t),x'^{t),. (t) and < 2 (t), the costate Vari- 
ables be denoted by Pi 2 (t),P 2 i(^)/ P^(0/ •••■/ Plii(^)' pI, 2 (^)- pLi(^)' 

pJii(f)/ and Pn 2 (^)/ routmg variables be denoted by *^12(0/ <^12(0/ / 

al,i(f), •vaLi(t)/ o^l^zi^)^ ■ ■ > <i{i) and al,2{t) 

Remark 5.2.1 The value of (t) at which the function equals ak ,2 is denoted 
by 

The performance index J to be mmimised is the total buffer occupancy bme 

/= P(,r;,(t)+J:; 2 W+ ■+J:[,iW + 4,2(0+ + 4 i(*) +< 2 ( 0 )* 

Jo 

The Hamiltonian is given as 

= {x{^+xl2+ . +xlx+<,Z+ +^LiW + 4.2W+ +<l+^nz{t)) 

+Pii(“'^n‘^ii +n|iW'^iW) 

+P12(~'^-^12^12 + ^{ 2 ^ 1 ) 

+ 

+pI,i(“/I,i(‘^Iii) + +a(A„_i)i-r{fci-i)i + a{ii-i)22:[i,i-i)2)) 

+PIi2(-«1:i2xI, 2 + aI.^2(A^i +tl(li-l)l2:(M_l)I + - 1 ) 24 , - 1 ) 2 ))) 
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+ . 

+PLi(-/Li(^Li) + + a(A,^-l)2X{fc^_l)2)) 

+Plm2i~<^k,r.Z^l„^Z + + «(/:„ + a(fc„ -l)23;(fc„ _i)2) ) ) 

+ . 

+Pnli~0‘nlX^nl + Q:nl(-^n + ti(n-l)ia:(„_i)i + a(n-l)23:(„_i)2)) 

+Pn2(-an2<2 + O^nzi^n + a(n-l)l3:(„_i)i + a(„_l)2a:[„_i)2)) 

It IS easily argued that the Hamiltoruan minimisation with respect to the routmg 
variables results m the followmg choice of the optimal routmg variables 
For J — 1-1^1 ^1 ? ^2) : ^vn 1 ri/ 

• If p'i(f) > Pj 2 (^) then a]i{t) = 0 and aj2(0 = 1- 

• If p’i(f) < Pj2(0 then a]i{t) = 1 and = 0. 

• If durmg an mterval (t) = p^ 2 (t) then the routmg variables are not specified 
by the above condihons 

The equation for the costate variables are given as follows 

Pii = — 1 + aii(Pn — ri2iP2i ~ ^nPzz) 

P\z — ~1 + ai 2 (Pi 2 ~ ^iiPzi ~ ^ziPzz) 


Pk^l = -1 + - «(A,i+1)iF(A.i+ 1)1 ^(fci+l)2P(fc,+l)2) 

pI,z = -1 + aii2(pli2 - Q'Cli+plPCli+l)! " ^{li+l)2P(li+l)2) 


pLi 

PkmZ 


+ <^k,nz{pl^2 ~ 


(pLi - «(U+l)lP{fcm+l)l ~ Ql(fc^+l)2P(fc„+l)2 

‘^(/.m+l)l^{^m+l)l ^(fcm+l)2P(A-m+l)2) 


Pnl — — l+«nlPnl 

Pn2 = -1 + O-nZPnZ 
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with the transversahty conditions (T) = 0; for j = 1, , n and for 1=1,2 


5.2.1 Properties of the Optimal routing strategy 

Certain interesting observations can be made regarding the nature of the optimal 
rouhng strategy for this network topology. These are stated in the followmg 
lemmas and theorems. 

Lemma 5.2.1 The costate variables (for j 
negative in [0, T] 

Proof : It IS easily verified that = - 

non-negative m the interval [0, T]. 

P(n-l)l — ^(n-l)l(P(n-l)l ~ <^nlPnl — *^n2Pn2) 

< -1 + a^n-DiPl-Di Vf G [0,T] andp[„_i)i(T) = 0. 

From the above inequality and the transversahty condition it can be argued by the 
following steps that (f) is greater than zero m the mterval [0. T) 

Compare with the function p{t) where p(t) satisfies the differential equa- 

hon 


= 1,2, , n and i = 1,1) are all non- 




and ^^ 2(0 




^ti2 


are 


p{t) = -1 -h a(„_i)ip, p{T) = 0. 
i.e. Pit) = — ^ 

0(n-l)l 


We have 


7^{n-l)l-P < a(n-l)l(P(„-l)l -P) 

= a(n-i)i(P(n-i)i - P) - Kt) where hit) > 0 
Since p[„^,^,iT) - piT) = 0, 
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Therefore 

It IS similarly argued that, 


> 0 Vt € [O.T) 

X — g'^(n— 

<2(n-l)l 


Smce 


Therefore 1 ) 2(0 ^ 


1 + <^(n-l)2P(n-l)2 P(n-1)2(^) = 0 

X — g“(n-l)2(i-l’) 

> 0 , vt6[o,r) 

a(n-l)2 ^ ^ 


P(n-2)1 (0 - -1 + <2(n-2)l {p\n-\)2 “ <^\n-\)\P\n-l)l “ ^[n-l)2P(n-l)2 

and smce (^) and P(„_i)2(0 as proved above are non-negative in [0, T), we get 
the relationship 

P(n-2)l(0 < “1 + <^(n-2)lP(n_2)l(0 

Hence P(n-2)i(0 > 

^(n~-2)l 

Similarly pL_2)2(0 > 

^ a(n-2)2 

Therefore both and P(„_2)2(0 are non-negative m [0, T\ 

Tlie above arguments can be easily applied for all the units between km and n. A 
similar argument (but with the following modification) can be used to prove that 
IS non-negative in [0, T]. 


PLi = -X + - Q(U4-1)iP(I^-.+ 1)1 - ^(U+l)2P(U+l)2) 


< 


dxi 1 

/vrn i- 

-i -1 TT Pk^l 


dx^ 


A.rn.1 


Compare Jt) with the function / {t) which satisfies the differential equation 

= -1 + f{T]=0 


fit) 


ie fit) 
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We have 

PL.-/W < -/{*)) 

Note that the function ^ is non-negative Let be denoted by a{t) and 
(pLi(^) ” /(O) denoted by y{t). Then 

y{t) < a{t)y{t), Vt6[0,r] 

y{t) = a{t)y{t) - h{t), where /i(t) > 0. 

y(t) = 

> 0, vt<r 


Thus (0 >f{t),yte [0, T). 






> 0, Vie[o,T). 


Thus the costate variable {t) is non-negative in [0, T] 

The above arguments can be easily extended to all the costate variables and 
hence the lemma. 

□ 


Lemma 5.2.2 In all the subunits of the network except the ones which have a link of finite 
channel capacity, all of the input trajfic is routed onto the faster link for the entire duration 
of network operation 

Proof : 

Without loss of generality, let us assume that the upper Imks of the subunit have 
larger Imk parameters (a^O than the corresponding one for the lower links, i e. 
On > ai2/ 021 > 022/ oa,,! > a^2>- ■ and Cni > o„2. 

It suffices to show that Pn(f) < Pni't)/ Piiil) < Pni(^) < Pnzi'^)' ^ [0. Ti to 
prove the lemma 
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Since Cnl > Cin2/ 


Pul(0 = 




^nl 


< 


Pnlit) = 


1 _ ea„2{t-T) 


^n2 


Therefore = 1, Vf e [0,T] 


Since Pji l + aj\{pji ^(j+i) 2 P(j 4 -i) 2 ) 

+ '2j2(Pj2 “ “Cj+i)iPo+i)i - ‘^c?+i)2P(j+i)2) forj 7^ ki^kz, km 

We have 

Pji ~ Pji ~~ i^h^Pji ~ ^]iPji) + (<2ji — + n(j+i)2P(j-i-i)2) 

~ ''hiPji (since the second term above is non-negative). 
Thus p]z-P’ji < («j 2P;2 - QjiPji) 

< ajzip]2-p]i) 

We have the transversality condition {Pjz{T) - Pji{T’)) = 0 It can be argued that 
if the function ij{t) is such that y < ay (where a > 0) and y{T) = 0 then y{t) > 0, 
'it <T Hence it follows thatp'2(0 > Pn(^)/ € [0, T) and consequently a]i{t) = 1, 

Vt e [o,r]. 

□ 

Thus the only network units in which a partial routing possibly take place are the 
ones with a link of finite charmei capacity. We had earlier established in Chapter 3 
in Lemma 3 3 1, that during an interval of partial routing the fraction of the traffic 
routed onto the faster link is the ratio of the channel capacity of the link to the 
total input traffic It is easily argued along the following lines, that in this network 
topology also, during any interval of partial routing, the fraction of traffic routed 
onto the faster link is the ratio of the charmei capacity of the Imk to the total input 
traffic arriving at the network unit ■ 

Durmg an interval in which the costate variables pf^{t] and pl^zi^) are idenhcal, 
their derivatives are also identical This, in turn, implies that the function is 
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identically equal to ak ,2 during this interval and hence the buffer occupancy xl ^(t) 
IS identically equal to Xk.tr- For the hmiting case where r tends to zero, during such 
an interval in which pt.i (t) and are idenhcal, the buffer occupancy in link 
IS identically equal to Xk.i^ and the routing variable ak,i(t) is given by 

^fcii 

Afc, (t) + a(k,-i)iX(k,-i)i + a(k,-i)2^(k,-i)2 

It can be argued that the properties of the optimal routing strategy which we 

proved m Theorems 3.3.1, 3.3 2 and 3.3.3 when the network umts k^, (i=l,2, m) 

are considered in isolafaon hold true when they are considered m conjunction with 
the other units as m the topology shown m Figure 5.1 We prove these results in 
two steps First we prove that the properties of the optimal routing strategy hold 
true for the A.,n-th unit Subsequently we extend them to all other units {K, where 

1=1,2, .. m-1) 


Lemma 5.2.3 Let a^i > aj 2 ,for j = km., km + 1, , n. Then the costate variables satisfy 

the following relationship 

= km, , (n - 1) and\ft e [0,T) 


Proof: (By induction) 

By Lemma 5 2.2, cv'ft) = 1, Vt G [0, T] and for j = km+T km+2, n. Therefore the 
differential equations for the costate variables pjj (t) and P(j+i)i (t) (hm < J < “ b)) 

are given as the following: 

W ~ P(j+i)i(^)) 

Po+i)i(^) = -1 + 00+1)1 (P(j+i)i (0 - Po+2)i(^)) 

Assume that the inequality stated in the lemma holds true for all j > I, for some / 

where km < I <‘n. 

Then 

P[l-l)li^) ~ — 1 + 0(/_l)l(P(i_i)i(^) ~ P/i(^)) 

p]^{t) = -1 + aniPait) - p\i+i)i{t)) 

- Phit) < a(^i-i)i{P{i-i)i - Pn) 



From the trairsversahty condition pf,_.,.(r) - pf.(r) = o, and from the above 
mequality, it can be argued that pf, _,„{() > fo, ^ ^ ^ 

Stated inequality holds true for all j > I, then it holds true for j = (/ - 1) also For 
the case / = (n - 1), the funchon as given by the foUowmg expression 

P(n-l)l(^)' 

- , 1 - e“"ht-r) _ ^a^^t-T) 

P(n-l)\\^) — 1 1 ^ 

flni a(„_i)i - a„i 

is greater than Vf € [0,T]. Therefore, by induction, it follows that for 

3 — {km + l)i (n — 1) /Pjl{t) > 

For the case j = km, the argument can be extended with the followmg modification 

dr 

ri,„i(0 = -i + ^(pL.W-P(r„,i),W) 

Pit,. +1)1 W = “l + “(U+l)l(P(l.+i)iW-P(t„+2)i(t)) 

> -1 as proved above. 

df^ 

p;,.i(0-P(i„+i)i < ;;^(pL,{i)-P(i.+i|i(t)) 

A.ml 

From the transversality condition = 0 and from the above 

inequality, it can be concluded that Vf G [0, T) 

Thus for all J 6 {km. {n ~ l)}rP'i(t) > Pl+ipit) 

Fience the lemma. 

□ 

Remark 5.2.2 : In the discussion that follows, the terms linear regime, transition 
regime and saturation regime and linear mode, transition mode and saturation mode are 
used in the same sense as in the definitions in Chapter 3 For example, if for all 
t in an interval I, is less than then such an interval / is termed as a 

linear regime for unit k, and the network unit is said to be operating in linear mode 
during the interval I If durmg an interval I, alj(f) lies between and j:(7,i)s 
then such an interval I is termed as a transition regime and the network unit k, is 
said to be opera tmg in transition mode during I Similarly, if durmg an mterval I, 
iljt) is greater than then such an mterval / is termed as a saturation regime 
and the network unit k\ is said to be operatmg in the saturation mode during / 
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Theorem 5.2.1 Tlie netiuork operation in the km-th unit can not end in 


(i) a saturation regime 


(li) a transition regime m which > Xk^tr 

The proof of this is quite along the Imes of that for Theorem 3 3.1 and therefore is 
not reproduced here 

Theorem 5.2.2 The routing variable is either 1 or 



for all t in [0, T] 


Proof : 

We prove that (t) < P[^„ 2 ) ^ ^ P) follows: 

Let \/t e I where / = [to, h] 

Then a[ ^(t) = 0, over I, and is a monotonically decreasmg function m I. 

As in the proof of Theorem 3 3.1, it can be argued that xl^-^{t) < xi^ir, Vt e I, and 
therefore 

Lm 1 

Thus 


jPLi 

Plm2 


-1 + - P(^.„+I)i) (Ly Lemma 5 22, = 1) 

“^/.ml 

-1 + aim2(pL2 ” P{l.„t+l)l) 


By Lemma 5.2.3, the term (p^i - is non-negative m [0, T] Therefore 


Pkml - 

Pk„,2 - “1 + '^fcm2(pL2 ~P(A.m+l)l) 


Pk 


•Pk 


> <2l,n2(Pfc„l ~ PL 2 ) 

> 0 (as per our assumption that pl^i (t) > 21 -^ 2 (^)) 


The above inequality implies that the difference between p',Jt) and p^t) will 
monotonically increase. Along the lines of Theorem 3 3 2. it can be argued that wiU 
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result m the violation of the the transversality condition (pl ^{T) - pl ^{T)) = Q 
Therefore the assumption of the existence of an interval I during which pl is 
greater than is mcorrect. Consequently < pl^^{t),Pt e [0,T]. We 

know that if durmg an interval ^ (t ) is less than pl^^ (i) then {t) equals 1 and 
if PLi(t) equals pl,„ 2 (f) then is given by the expression 

/ fcml(^fe'ntr) 

+ a(fc„-l)lX[i,^_l)l + (1{^„-I)23:[fc^_l)2 

Hence the theorem. 


□ 


Theorem 5.2.3 An interval of partial routing in the km-th unit can not be 

(a) followed by a transition regime in which xl^^f) < Xk^tr 

(b) preceded by a transition regime in which xl^if) > x^^tr 

The proof of this theorem is along similar Imes as that for Theorem 3 3 3 and is 
therefore not reproduced here. 

We can easily extend the Lemma 5.2 3 and the Theorems 5 21, 5.2.2 and 5 2.3 to the 
other network units also 

Lemma 5.2.4 Let Uji > (ijirfor i e {1, 2, [km - 1) } L/ien the costate variables satisfy 

the relationship pfit) > p\j^ip{t), Vt 6 [0, T) and for j € {1, 2, ., {k-m — 1)} 

Proof : 

We have already established in Lemma 5 2.3 that pl^^ (t) > (t) By Theorem 

5 2 2,p;^^_(f) < pl^ 2 i^),Vt e [0,T] Therefore the differential equations for the costate 
variables and pl^i{t) are given as the followmg 

ri.i = -i + |N-(pLi(')-pL+wW) 

km 1 

By Lemma5.2 2, ipljt) - pI„u)M is positive in [0. T) Therefore 
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The above inequality along with the transversality condition (T) ~pl ^{T) 


0 results m the condition Vi s [O.T) The arguments based 


on induction that were used in the proof of Lemma 5 2 2 can be extended for 

] G l)i (^m 1)} 

Using the fact is non- negative m [0, T), Theorem 5 2.2 can 

be extended to the network unit also, and it can be argued thatp[^^_j)j(t) < 
^ sequence of arguments which were used m 

establishing that p’jy{t) > p\j+^)^{t) for all 3 € {k(ra-i),k^m-i) + 1, , {k^r, - 1)} can 

now be extended for; G {^(m- 2 ), , (A:(m-i)-l)} In other words, p;i(t) > p^^^pit), 

Vj G {A,(;„_ 2 ), (A(,„_ 2 ) H-l), , -1)} Usmg the fact that > Pq„_j) 2 (t), 

It can be proved along the lines of Theorem 5 22thatpi^^_^p < pl^ G [0, T) 

The sequence of arguments can be extended to all other units m an exactly similar 
manner and hence the lemma. 


□ 


Theorem 5.2.4 The network operation in the krth unit (i = 1,2, (m- l)j can not 

end in 

( I ) a saturation regime 

( II ) a transition regime in which vlp{t) > xi,pr 

The proof is exactly along the lines of that for Theorem 3 31, which makes use of 
the fact that if the network operation ends in an mterval in which > xi^^trf 
then it should have started with an initial buffer occupancy value which is greater 
than . But this is not the case as per the assumptaon that the network operation 
starts in the linear mode. 

Theorem 5.2.5 The routing variable cxlp{t) is either 1 or 



Aa.( 0 + a(A.-l)l-^^(l,-l)l + a(fc,-l)22'’('l.-l)2 


for all te [o,r]. 
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The proof of this is exactly along the lines of Theorem 5 2 2 and is therefore not 
reproduced here 

Theorem 5.2.6 An interval of partial routing in the k^-th unit (i = 1, 2, (m - 1)) can 
not be ■ 

(a) followed by a transition regime in which xl^ft) < Xk,tr 

(b) preceded by a transition regime in which > Xk,tr 

Proof : 

It can be argued along the Imes of the proof for (a) in Theorem 3 2.3 that if an interval 
of partial routing is followed by a transition regime in which Vk,tv < then the 
function - pf 2 {^)) continues to be a posihve and monotonically mcreasmg 

function till t = T. This results m the violation of the transversality condition 

(PM(r)-pb(^))=0- 

It can also be argued (as in the proof of (b) of Theorem 3 2.3) that a necessary 
condition for an interval of partial routing to be preceded by a transition regime m 
which i[ft) > u,t 7 / is that the network operation starts with an mitial buffer 
occupancy x[j{0) > , ,, Since as per the assumption that the network operation 

starts in the linear mode (for all the units), this necessary condition is not satisfied 
and hence an interval of partial routing can not be preceded by a transition regime m 
which > Xkj,. 

□ 

Thus we see that the properbes of the optimal routmg strategy which were proved 
when the network units are considered m isolation hold true even when they 
are considered m conjunction with the other units This allows us to make the 
following conclusions regardmg the optimal strategy for this topology 

• In all the subunits which have both the links of mfmite channel capacity, 
the globally optimal routing strategy is the same as the locally optimal routmg 
strategy. This corresponds to a routing of all the mcommg packets onto the 
faster link for the entire duration of network operation 
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. In all other subunits (which have the /aster link of finite channel capacity) 
either the entire traffic is routed onto the faster link or there are intervals of 
partial routing during which a fraction equal to the ratio of the channel capacity 
to the incoming traffic, is routed onto the faster link. These intervals of partial 
routing can not be be preceded by a transition regime m which xl /t) > Xk tr, 
and can not be followed by a transition regime m which xl /t) < Xk tr 

In the next subsection we explore a procedure to specify these intervals of partial 
routing for the case of a topology m which only one subunit has a link of fmite 
channel capacity (correspondmg to the case m = 1) 

5.2.2 Single unit with a link of finite channel capacity 

In the discussion that follows we consider the case where r tends to zero. Let us 
also assume without any loss of generality that the upper link in each unit is faster 
than the lower link In other words, an > an, azi > azt,- , Oni > u.ni- Therefore by 
Lemma 5 2.2, in all the units which have both the links of infinite channel capacity, 
all the incoming traffic is routed onto the upper Imk for the entire duration of 
network operation. 

Assume that the total input traffic Aa,// + a(k^-i)iX(^-i)i + a(A,j_i) 2 a:(A,j_i )2 arrivmg 
in the ki-th unit has 'n' positive crossings above the value equal to From the 
above theorems, it can be concluded that intervals of partial routing, if they exist, are 
of the type [L, , h], ^ 2 ], • • where the instants tsi, t^, . correspond to those at 

which Xkx 1 (f) reaches the value Xk^o- At U, and t* we have the following conditions 


Xkniii) = Xk,i{t*) = Xkns- 


The unit ki operates in the saturation mode during [Li f*] with — 1 Therefore 


•CAjI =~C'aj1 + Aai + a(Ai-i)ir;(A.i-i)i + a(Ai-i)2-r(fci-i)2 

Hence xm{t*) - x^iiU) =f ' (Aa/O +-a(Ai-i)i-r(fci-i)i (0 + X{ki-i)2X(ki-i)2 - 

J ti 
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During the interval link has linear dynamics. The dynamics of 

durmg this mterval is given by 


Pk^\ = -1 + afcji(pfcji - P(ifcj+i)i) 

Att = = Pfci 2 (is.+i)- Therefore 




and 


PkriiU) = iK - ir) + PkAK+iV^'^'' / ‘ e + ariiP(i.+i)i(^))* 




Smce p^^l(^^) = Pki 2 {ii), we get the followmg equations m tg,, U and t* 
For 1 — 1,2, n, 


Pk.iiU) = 

f ‘ + afc,ip(i,+i)i(r))dr 

'^ts. 1 1 


(5 4) 


As mentioned earlier, the expression for pi^iit) and P(A,i-|-i)i(t) are obtained from 
solving the differential equations m them which can be done recursively by startmg 
from Pni(t), followed p(„_i)i(t), and so on. 

Thus we observe that to specify the instants ti, t*, tsz, t 2 , ts^, ts, the 

above sets of Equations (5 1), (5.3) and (5.4) need to be solved 

Example : Consider the case where n = 3, A;i = 2 as shown m the Figure 5.2. 

The equations for P 3 i(t) and P 2 i{t) are as follows. 


P3l(0 = 


1 _ gCisiit-T) 
^31 


^ QO,22{t—T) 2 — Q°-ZL{t—T) ga3l(l~D 

P22{t) = 1 1 r 

0.22 <331 {022 “ <331 ) 

The equations to be solved to specify the mstants tj, ts 2 , t 2 , ^2/ - -• ^sn/ ^71/ t* are 

as follows- 



(A2(t) + <3llXn(t) + <3l2^12(^))<^f 


C'2l(t* - tz) 


(5.5) 
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^12 <322 (332 

Figure 5 2 Network topology for n = 3 , /ci = 2 


X2is{l - e e“^i^(A2i(r) + auxn + ai2Xn)dr (5.6) 


^^22 ^31 

(«22“«3l) 


(t* — U) + , 


022 <^31 




^ 22*~<^31 

(k:£fil!l:!2±il)(X + J_) + 

' ^21 '' ^21 ^31 

“31 (“31— 0-21 ) 


(5.7) 


The function a’ii(f) in equation (5.4) is obtained by solving the dirterential equation 


■Til — — fiiiaiii + Ai(t) 

le a;n(f) = a;u(0)e”“''‘ + / Ai(r)e““'^dT 

do 

and xuit) = ^ 12 ( 0 ) 6 '”“’^^ 


Thus we observe that for solving the above set of equations in ti, t^, ts 2 , to, tj, 
■ -dsn, tn, tn we need to know the loads Ai(f) and A 2 (it) for the entire duration 
[0, T] Analytical solutions to these equations are difficult to obtain Therefore 
as suggested in the Chapter 3, consider the suboptimal algorithm m which we 
route the fraction of the mcoming traffic needed to keep the Imk (2,1) flowout at its 
channel capacity mput load to unit 2 (Ai (t) +nuXn +cti 2 r‘ 12 ) 

is greater than C 21 The remammg traffic is routed onto link (2,2) during this 
interval Notice that this is also the subopbmal algorithm for the imit 2 when it is 
considered m isolation The examples given below give the relative performances 
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of the optimal strategy and the suboptimal strategy for some typical input load 
on the network. We also compare the performances of these strategies with the 
best performance that is achievable when all the links of the topology have infimte 
channel capacities. 

5.2.3 Numerical Examples 

Consider agam the case where n =3, k=2 Let the link parameters be as follows: 
an = 0 9, an = 0 2, azi = 0 7, an = 0 3, asi = 0 6, 032 = 0.1, C 21 = 7, X2is = 10 
Let the network operation be for a duration [0, 10] 

Example 5.2.3.1 : 

Let Ai(t) = A 2 (t) = As(t) = 5 for the entire duration [0, 10] Assume that the mitial 
buffer occupancies are all zero. 

The total traffic arrivmg at node 2 is given as. 

Aiit) + ana:ii + an-r 12 = 5 + 5(1 - e"° shown below: 



Figure 5 3. Total Load Arriving at Node 2 for Example 5.2.3.1 
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time 


Figure 5 4 Buffer Occupancies under the Optimal and Suboptimal Strategies for 
Example 5 2.3 1 


Table 5 1. Optimal and Suboptimal Strategies for Example 5 2.3 1 


Optimal Strategy 

Suboptimal Strategy 

^11 (i) = Oi3i{t) = 1, Vt E [0 10] 

Oii(t) = 03 i(t) = l,Vt € [0, 10] 

n 2 i(f) = 1 over [0. 2 4614] 

021 (t) — 5+5(i_e-o9() over (2 4614, 10] 

021 (f) = 1 over [0,2 4614] 

021 (f) = 5+5( over (2 4614, 10] 

Jopt = 341 7782 

Jsubopt = 341 7782 


Example 5.2.3. 2: Ai(t) = X 3 {t) = 3 0 for all t G [0 10] 


A2(t) 


2 / over [0. 2 5] 

< 5 / over [2 5, 7 5] 
2 ; over [7 5, 10] 
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Figure 5.5: Total traffic arriving at node 2 for Example 5 2.3 2 



Figure 5 6 Buffer Occupancies under the Optimal Strategy for Example 5.2.3.2 
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Figure 5 7 Buffer Occupancies under the Suboptimal Strategy for Example 5.2.3 2 


Table 5 2: Optimal and Subo] 

Dhmal Strategies for Example 5 2 3 2 

Optimal Strategy 

Suboptimal Strategy 

aii{t) = Oisi(t) = 1, Vt e [0, 10] 

an{t) = a 3 i(t) = l,Vt € [0,10] 

Q-' 2 i(f) = 1 over [0,4 798] 

^21(4 = 5+3fJe-09e) over (4 798,7 3] 

021 (^) = 1 over [6,4 798] 

021 W = over (4 798,7 5] 

021 (^) = 1 over [7 3. 10] 

a 2 i(t) = 1 over [7 5, 10] 

Jopt = 206 894 

J subopt — 208 322 


Example 5.2.3.3: 


Ai(t) 


f 2 , over [0, 2.5] 

< 5 ; over [2 5, 7 5] 
2 , over [7.5, 10] 
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Xzit) 


2 ; over [ 0, 2 5 ] 

■! 5 ; over [2 5, 7 5] 
2 ; over [7 5, 10 ] 


AsW =5,Vt € [0,10]. 



Figure 5 8 . Total Load at Node 2 for Example 5 2 3 3 


Table 5.3 Optimal and Suboptimal Strategies for Example 5 2.3.3 


Optimal Strategy 

Suboptimal Strategy 

= 0^31 (0 = 1 / Vi £ [ 0 , 10 ] 

0^11 (^) = 0:3i{t) = 1, Vi £ [0, 10] 

= 1 over [0, 4 3] 

Q; 2 i(i) = 1 over [0,4 3] 

_ (f) _ 7 ^4 o 7 51 

a2l[t) — 10-3 ZlOSe-*^ 9(^-2 5 )) ^ 


Q 2 i(i) = lover [7 25,10] 

0:21 (i) = 1 over [7 5, 10] 

Jopt = 286 68763 

d.K 6 opt = 296 78209 
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Figure 5 9 Buffer Occupancies under the Optimal Strategy for Example 5 2.3.3 



Figure 5.10 Buffer Occupancies imder the Subophmal Strategy for Example 5.2.3.3 
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Example 5.2.3.4: 


AiW=A3(i)=2,ViG[0,10]. 


A2(i) = < 


2 ; 

over [0, 2 5] 

10 ; 

i 

over [2 5, 5 0] 

2 ; 

over [5 0, 7 5] 

. 10 1 

over [7 5, 10] 


Table 5 4. Optimal and Suboptimal Strategies for Example 5.2 3 4 


Optimal Strategy 

Suboptimal Strategy 

Q:ii(^) = 0-31 (t) = l,Vt E [0, 10] 

a;ii(t) = Q3i(t) = l,Vt e [0. 10] 

Q! 2 i(i) = 1 over [0,3 386] 

a2i (i) = 12-21-0 9^ over (3 386.4 71] 

021 (i) = 1 over [0 3 386] 

021 (i) = over (3 386 5] 

021 (0 = 1 over [4 71 8 04] 

021 (i) = 1 over [5. 8 08] 

021 (0 - i 2 _/e-o« over (8 04, 10] 

021 W - i2-2e-0 9‘ over (8 08. 10] 

= 220 92 

J subopt ^ 221 7122 



Figure 5 11 Total Load at Node 2 for Example 5 2.3 4 
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Figure 5 12: Buffer Occuparrcies under the Optimal Strategy for Example 5 2 3 4 



Figure 5 13 Buffer Occupancies under the Subophmal Strategy for Example 5 2.3.4 
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5.3 Network topology of three-node units. 

Consider a network shown in Figure 5 14 composed of the three-node network 
units which we considered in Chapter 4 It was shown m Chapter 4, that if all the 
Imks of this network unit are of infinite channel capacity, then the routing strategy 
depends only on the link parameters of the network The optimal routing strategy 
was specified m terms of an inter-regime switchmg mstant An equation (in the 
Imk parameters of the network and the total duration T of network operation was 
derived) the solution to which specifies this switchmg instant 
For the above network topology (shown m Figure 5 14), consider the globally opti- 
mal routing strategy which mmimises the total buffer occupancy of the network 

/.■jP 

/ (-i-'U + -i^lS + ^21 + ^23 + ^45 + 4 - 0:54 + 2:56 -f Xys + X79 + Xs7 -f X89)dt 

Jo 

for the case wherem all the umts are of Imks of infinite channel capacity. The system 
dynamics for this case is given by 


ii2 = 

—0122:12 + 0:12(0 (-^iC^) + 2212:21) 

(5 8) 

^13 = 

—0132:13 + 0:13(0 (Ai(0 + 0212:21) 

( 5 . 9 ) 

2:21 = 

—0212:21 + o;2i(0(A2(0 + 2122:12) 

( 5 . 10 ) 

X23 = 

—0232:23 + 0:23(0 {^2(0 + 212X12) 

( 5 . 11 ) 

^45 ~ 

-045X45 + 0:45(0 (A 3(0 + 254X54) 

( 5 . 12 ) 

2:46 = 

- 046 X 46 - 1 - 0:46(0 (A 3(0 + 254X54) 

( 5 . 13 ) 

2-54 = 

— O54X54 - 1 - 0:54(0 (A 4(0 + 245X45) 

( 514 ) 

2'56 

— O56X56 + 0:55(0 (A 4(0 + 245X45) 

( 5 . 15 ) 

J-’/s = 

— 073X78 + 0 : 78 (t)( 0 i 3 Xi 3 + O23X23 + 237X87) 

( 516 ) 

X79 = 

— O79X79 -h 0:79(0(213X13 + 023X23 + 037X87) 

( 5 . 17 ) 

2:87 = 

—037X87 4 - 0 : 87 (t) (045X46 4 " 055X56 4 " 078X73) 

( 518 ) 

2:89 = 

— 039X39 4 “ Q: 89 (t) (O46X46 4 " 055X56 4 “ 078X73) 

(5 19 ) 
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The Hamiltonian for this system H is given by 

H = Xi2 -|- Xi3 -1- X21 -t- X23 -f- 0:45 -f 0:54 + 2:46 -1~ 2:56 -|- X78 + 2:79 -H 
X87 + 2^89 -H P122:12 + Pl32:i3 + ^212:21 + ^23X23 + P45X45 + 

P46X46 + P54X54 + P56X56 + P78X78 + P79X79 + P87X87 + ^89^89 

As m the case of the constituent three node umt, the optimal routing strategy for 
this composite network is bang-bang in nature with the followmg values for the 
routing variables. 

• If durmg an mterval I, pjk{t) > Pji{t) then a^kii) = 0 , = 1 

The costate variables Pjk{t) are obtained by solvmg the followmg set of differential 
equations 


Pl2 


— 1 + <2i2(P12 ~ n2lP21 ~ CtTSPas) 

(5.20) 

Pl3 


— 1 4- 013 (pi3 — Q!78P78 — <^79P79) 

(5.21) 

P21 


— 1 + 021 (P21 " CK 12 P 12 — CClSPls) 

(5 22) 

P23 

=: 

-1 + ClTsiPTZ - Ci7SP7S - 0179P79) 

(5.23) 

P45 

= 

-1 + 045(P45 - Q:54P54 “ a56P56) 

(5 24) 

P54 

= 

— 1 -f- 054(p54 - n45P45 ~ <^46Pi6) 

(5 25) 

P46 

== 

-1 4- 046 (P46 - a87P87 “ Q89P89) 

(5.26) 

P56 


-1 + 056 (P56 - a87P87 “ ^SSPas) 

(5 27) 

P78 


— 1 4- 078 (P78 ~ a!87P87 ” Cii9Pi9) 

(5.28) 

P87 

= 

-1 4- 087(P87 - a78P78 " 0:79P79) 

(5.29) 

P79 

= 

—1 4- a79P79 

(5 30) 

P89 


-1 4- 089P89 

(5.31) 


with the transversality conditions Pjk{T) = 0. 

Since the set of equations m the state vanables and the costate variables are decou- 
pled, and since the routmg variables depends only on the costate variables, it is 
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Table 5 5: Companson of the performances of the globally optimal and locally optimal 
routing strategies for a load Ai = A2 = A3 = A4 = 10 


No 

LINK PARAMETERS 

Ji 

J2 

ai2 

ai3 

021 

0^23 

<^45 

046 

054 

056 

0/8 

079 

087 

089 

1 

02 

05 

0.2 

05 

0.2 

06 

0.2 

0.6 

0.1 

05 

0.1 

05 

1113.2 

1113.2 

2 

09 

0.2 

01 

0.8 

02 

06 

0.2 

06 

0.1 

05 

01 

0.5 

972.16 

1102.4 

3 

02 

0.8 

07 

0.2 

08 

0.1 

0.1 

08 

0.1 

05 

01 

05 

1103.2 

1154 8 

4 

0.2 

08 

07 

02 

08 

01 

01 

0.8 

07 

02 

0.1 

09 

1107.6 

1231 7 

5 

01 

0.7 

0.8 

01 

01 

01 

09 

0.8 

0.2 

08 

06 

0.1 

1161.8 

1169 8 


easily seen that the ophmal routmg strategy depends only on the Imk parameters 
CjA, of the network and is independent of the mput loads Ai(t), Xzit), ^ 3 ( 1 ) and 
As the number of layers m the network mcreases, the number of equations in the 
costate variables also mcreases For the topology shown m Figure 5 14 with two 
layers, in order to obtam the globally optimal routmg strategy and the corresponding 
ophmal buffer occupancies, the above set of 24 differenhal equahons (Equahons 
(5 8) to (5.31)) have to be solved Consider mstead, the network performance under 
a scheme m which ophmisation is done local to the individual units In Chapter 4, 
we have already looked at this problem and showed that such locally optimal strate- 
gies for each network unit can be specified by an inter-regime switchmg instant t, 
which IS easily obtamable from the Imk parameters of the umt. For a choice of 
Ai(t) = 10, X 2 {t) = 10, X 3 {t] = 10 and Xi(t) = 10 and Imk parameters the Table 
5 5 gives a quanhtahve difference m the performance of the network for the two 
schemes Ji is the performance mdex imder the globally optimal routing scheme and 
J2 is the performance mdex under the locally optimal routing scheme The network 
operahon is assumed to be for a durahon of 10 units, 1 e T = 10 and the initial 
buffer occupancies are all assumed to be zero 


The various cases m Table 5 5 are illustrahve of the various modes in which the 
nehvork operates under the two strategies Case 1 corresponds to a situation, 
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where both the globally optimal strategy and the locally optimal strategies are the 
same with a direct routing of the packets in all the three network umts. In other 
words, the routing variables 0:13 (t), 023(0 <^46(0/ «56(0/ Q!89(0 are unity m the 

entire duration of network operation The performance of the two strategies are 
same for this case. 

Case 2 corresponds to a a situation in which there is a regime 2 to regime 4 transition 
in the network unit 1. In the network umts 2 and 3, the mcommg traffic is routed 
onto the direct paths for the entire duration [0, T] under both the strategies. Under 
the globally optimal strategy, this regime transition (from 2 to 4) takes place at 
ts = S3, while under the locally optimal strategy, this takes place at = 8 8 
Case 3 corresponds to a situation m which the network unit 1 has an inter regime 
switchmg from regime 3 to regime 4, while in the unit 2 there is an inter regime 
switchmg from regime 2 to regime 4. The routing m the network unit 3 is a direct 
routmg for the entire duration [0, T] Under the globally optimal scheme the inter 
regime switching m unit 1 takes place at = 7 7 and m unit 2, at = 9 3 Under 
the locally optimal scheme the mter regime switchmg m unit 1 takes place at = 8 2 
and the switchmg mstant m the network unit 2 is at = 9 5 
Case 4 corresponds to a situation in which the network unit 1 has an inter regime 
switchmg from regime 3 to regime 4, unit 2 has a switching from regime 2 to regime 
4, and unit 3 has a switchmg from regime 2 to regime 4 These instances are at 
= 7 3, = 9 2 and at = 8 4 for the units 1, 2 and 3 respectively for the globally 

optimal strategy, while for the locally optimal strategies they are at = 8 2, = 9 5 

and ts = 8 4. 

Case 5 corresponds to a situation in which all the three units have a mter regime 
switchmg from regime 3 to regime 4. These instances are at ts = 9 2, ts = 8 3 and 
at ts = 9 2 for the units 1, 2 and 3 respectively for the globally optimal strategy, 
while for the locally optimal strategies they are at ts = 9 4, ts = 8 8 and ts = 9 2 
respectively 

When a direct Imk of one of the basic units is of fmite channel capacity, the network 
operation may go into saturation when the traffic on this link is high. Smce the 



5.4 Optimal routing in a four-node hub network 


184 


maximum rate at which packets can be sent on this link is restricted to the channel 
capacity of the link and smce for the rest of the links there is no upper bound on the 
rate at which packets can be drawn out, it is mtuihvely justifiable to redistnbute the 
total mput traffic in the network so that the network operates m the linear mode for 
the entire time span of network operation. Consider a situation in which link (1,3) of 
network imit 1 has a finite channel capacity A possible way to operate the network 
m the Imear mode is to send the excess traffic (which causes the buffer occupancy 
m the link (1,3) mcrease beyond the value 0 : 13 ^ to the network umt 2 Figure (5.15) 
illustrates this scheme As mentioned above the routing strategy m the network 
can be either globally optimal or locally optimal for the constituent units and the 
network operation may be constramed to the linear mode with either of the routing 
strategies m operation Table 5 6 gives the performances under the globally optimal 
routing strategy and the locally optimal routing strategy (with the network operation 
bemg confmed to the linear mode) for the above five cases of link parameters (given 
m Table 5 5) The mput traffic is assumed to be Xi{t) = \ 2 {t) = A 3 (t) = A 4 (f) = 10 
for the entire duration of network operation [ 0 , 10 ] 

5.4 Optimal routing in a four-node hub network 

Consider a network topology shown m Figure 5.16 Nodes 1, 2, and 3 are source 
nodes and node 4 is the destination node At each source node, there is a direct 
path to the destmation and alternate paths through the other source nodes. The 
above network can be viewed as being composed of 3 three-node network units of 
Chapter 4, wherein adjacent units share a common link. We investigate the nature 
of the optimal routmg strategy for this network when all the links of the network 
are of mfmite channel capacity. 



Table 5 6 Performances of the Globnllij oplwml and hcnlbj optimal strategies with the traffic splitting scheme 
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Figure 5.16. Four node hub network. 

The dynamics of the network is given by the followmg set of equahons 


2:12 = 

— ai 22;42 + ai2(t)(Ai(t) + 021X21 + 031X31) 

( 5 . 32 ) 

2:13 = 

— 013X13 + Otu{t){Xi{t) + 021 2^21 + O31X31) 

( 5 . 33 ) 

Xu = 

— O14X14 4- Q!i4(t)(Ai(t) + O21X21 + O31X31) 

( 5 . 34 ) 

2:21 = 

— 021X21 + 0:2l{t){X2{t) + O12X12 + O32X32) 

( 5 . 35 ) 

X23 = 

— O23X23 + (X 23 {t){X 2 {t) + O12X12 + O32X32) 

( 5 . 36 ) 

X24 = 

— O24X24 + Oi 24 {t){X 2 {t) + 0,12X12 + O32X32) 

( 5 . 37 ) 

2:31 = 

-O31X31 4 - Q!3i(t)(A3(t) + 013X13 4 - O23X23) 

( 5 . 38 ) 

2^32 = 

-032X32 4 - a32{t){X3{t) 4 - 013X13 4 - 023X23) 

( 5 . 39 ) 

2:34 = 

—034X34 4 " Q;34(t)(A3(t) 4 O13X13 + 023X23) 

( 5 . 40 ) 


Consider a routmg strategy which mmimises the total buffer occupancy tune J 
given below 

fT 

T = / (xi2 + Jl3 + Xi4 + 2:21 + 2:23 + 2:24 + 2:31 + 2:32 + X34)dt 

20 

The Hamiltoman for this system is given as 


H 


X12 + Xi 3 + Xi 4 + 2:21 + X23 + 2:^24 + 2^31 + 2132 + X34 
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+P12XU -I- Pl3Xiz + PuXu + PllXii -h P23a;23 + Pt^Xi^ 

+P3ia:31 + P31X32 + P34^34 

Substituting the dynamics given by Equations (5.32)-(5.40) we get 

H — X\2 -f 0713 + Xi 4 + X21 + 0:23 + 2:24 + 2731 -f- X32 4- X34 

+Pl2(— ai22;i2 + Q!12 (Ai -f- 021X21 + 031X31)) 

+P13(~<21327 i 3 + Q!i3(Ai + O21X21 + O31X31)) 

+Pl4(~ai42^14 + 0;14 (Ai + 021X21 -I- 031X31)) 

+P2l(~^i2l2721 + U2 i(A 2 + O12X12 + O13X13)) 

+P23( ”<223X23 + U23(A2 + Xi22^12 + Q32X32)) 

+P 24 ( ”<224X24 + n 24 (A 2 + O12X12 + 032X32)) 

+P31 (”<231X31 + Q;3 i(A 3 + O13X13 + O23X13)) 

+P32(” <2322732 + U32(A3 + 013X13 4- 023X13)) 

+P34( ”<2342734 4- a34(A3 4- 013X13 4- 023X13)) 

Minunismg the Hamiltonian function w r.t the routing variables is equivalent to 
minimismg the expression 

(P12<3<12 4-pi3Q!l3 4'P14<2:14 )(Ai 4" 021X21 4" 031X31) 

4-(P21Q:21 + P 23<^23 4- P240<24)(A2 + <21227 i 2 4- O32X32) 

+ (P31<^31 +P32<^32 4-p34Q:34)(A3 4- O13X13 4- O23X23) 

Smce the terms (Ai 4- 021X21 4- 031X31), (A2 4- 012X12 4- 032X32) and (A3 4- 013X13 4- 023X23) 
are non-negative the optimal routmg variables are specified as follows. 

• The optimal routing variables anit), <3:i3(i) arid Q;i 4 (t) where 0 < a:i 2 (t) < 1/ 
0 < ai 3 (t) < 1, 0 < ai 4 (t) < 1 and Q:i 2 (t) 4- Q:i 3 (t) 4- Q;i4(t) = 1 are such that 
they mmimise the term (pi 2 <ai 2 + Pi3<^i3 + Puf^u) 

• The ophmal routmg variables (y. 2 i{t), 0 : 23(0 ^rid oc 2 i{t] are such that they 
minimise the term (P 21 O 21 4- P23<a23 + P240:24) 
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• The optimal routmg vanables a 3 i(t)/ c^zit) and a: 34 (^) are such that they 
minimise the term {pzioczi + Pzzctzz + 

Let pi{t) be the minimum of pnit), Pisit) and pu{t). Then for j € {2, 3, 4} 

1 ifpij(f) =pi(f) 

0 otherwise 

Similarly, let ;P 2 (i) be the minimum of p2i(t)/P23(t) and p24(f) Thenforj G {1,3,4} 


aij{t) = 


azjit) = { 


1 lfp2j(f)=Mf) 
0 otherwise 


And, let p 3 {t) be the mmimum of P 3 i{t), P 3 z{t) and p^{t) Then for j e {1. 2, 4} 

I 0 otherwise 

The costate variables are are given by the followmg differential equations: 


P\z 


— 1 + ai 2 (Pl 2 - n 2 lP 21 - C123P23 “ n24P24) 

(5.41) 

Pl3 


— 1 -H ai3(pi3 - a3iP3i - a32P32 - CXuPza) 

(5.42) 

Pl4 

= 

—1 + auPu 

(5.43) 

P 21 

= 

— 1 + 021 (P 21 - ni 2 Pl 2 - ni3Pi3 - auPu) 

(5.44) 

P23 

= 

- 1 - 1 - a23{P23 — n3lP31 ~ n32P32 — n34P34) 

(5.45) 

P24: 


— 1 a24P24 

(5.46) 

P31 


-1 + 031 (P 31 - ni 2 Pl 2 - ni 3 Pl 3 - ni 4 Pu) 

(5.47) 

P32 

= 

— 1 -f 032(p32 ~ n 2 iP 21 ~ Oi23PZ3 ~ OCz^PZi) 

(5.48) 

P34 


-1-1- 034 P 34 

(5.49) 


along with the transversality condihons Pja,(T) = 0 The solutions for puit), pziit) 
and p 3 i{t) are given as 
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Pziit) 

PMit) 


I — 


<324 


<334 


Remark 5.4.1 : It can be argued from the above set of differential equations in 
the costate variables that there do not exist intervals durmg which pi 2 (t) = pi 4 {t) 
and/or pi 3 {t) = puii) Similarly mtervals durmg which P 2 i{t) = P 2 i{t) and/or 
P 23 {t) = P 2 i{t) and/or p 3 i(t) = p 34 (t) and/or p 32 (t) = puit) also do not exist. If 
durmg an mterval I, puii) = Pi3(t) = Pi{t) (a case correspondmg to singular 
solutions) then it can be argued that durmg I, au{t) = 0 and any choice of Q:i 2 (t) 
and Q;i 3 (f) which satisfies the normalizmg conditions is an optimal strategy This 
observation applies to other cases also. Smce a choice of unity for one of the 
(associated) routing variables under these situations is also an optimal choice, 
m the discussion that follows we restrict our attention to the class of bang-bang 
strategies. 

Since the ophmal routmg strategy at each source node is bang-bang with one of the 
associated routmg variables always taking the value equal to umty, we have the 
followmg 27 possible regimes of operation which are given m Table 5 7. The optimal 
routmg strategy for this four node network has certam mterestmg properties which 
are given below as theorems. 


Theorem 5.4.1 The network operation always ends in regime 27 wherein the incoming 
packets at the source nodes are routed on the direct links (1,4), (2,4) and (3,4) 


Proof: 

We prove that the rest of the regimes are ruled out as termmal regimes as follows. 
Regimes 1,2 and 3 : In all these three regimes, the routmg variables auit) and 
Q; 2 i(t) are equal to imity The dynamics of pi 2 (t) and p 2 i(t) are given as 


Pnit) = -1 + ai2(pi2 - P21) 
P2l{t) = -1 + <321 (P21 - P12) 
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Table 5 7. P ossible regimes of network operation 


Regime no. 

U'l2 

Ul3 

Ul4 

U21 

U23 

U24 

U31 

U32 

U34 

Regime 1 

1 

0 

0 

1 

0 

0 

1 

0 

0 

Regime 2 

1 

0 

0 

1 

0 

0 

0 

1 

0 

Regimes 

1 

0 

0 

1 

0 " 

0 

0 

0 

1 

Regime 4 

1 

0 

0 

0 

1 

0 

1 

0 

0 

Regime 5 

1 

0 

0 

0 

1 

0 

0 

1 

0 

Regime 6 

1 

0 

0 

0 

1 

0 

0 

0 

1 

Regime 7 

1 

0 

0 

0 

0 

1 

1 

0 

0 

Regime 8 

1 

0 

0 

0 

0 

1 

0 

1 

0 

Regime 9 

1 

0 

0 

0 

0 

1 

0 

0 

1 

Regime 10 

0 

1 

0 

1 

0 

0 

1 

0 

0 

Regime 11 

0 

1 

0 

1 

0 

0 

0 

1 

0 

Regime 12 

0 

1 

0 

1 

0 

0 

0 

0 

1 

Regime 13 

0 

1 

0 

0 

1 

0 

1 

0 

0 

Regime 14 

0 

1 i 

0 

0 

1 

0 

0 

1 

0 

Regime 15 

0 

1 

0 

0 


0 

0 

0 

1 

Regime 16 

0 

1 

0 

0 

0 

1 

1 

0 

0 

Regime 17 

0 

1 

0 

0 

0 

1 

0 

1 

0 

Regime 18 

0 

1 

0 

0 

0 

1 

0 

0 

1 

Regime 19 

0 

0 

1 

1 

0 

0 

1 

0 

0 

Regime 20 

0 

0 

1 

1 

0 

0 

0 

1 

0 

Regime 21 

0 

0 

1 

1 

0 

0 

0 

0 

1 

Regime 22 

0 

0 

1 

0 

1 

0 

1 

0 

0 

Regime 23 

0 

0 

1 

0 

1 

0 

0 

1 

0 

Regime 24 

0 

0 

1 

0 

1 

0 

0 

0 

1 

Regime 25 

0 

0 

1 

0 

0 

1 

1 

0 

0 

Regime 26 

0 

0 

1 

0 

0 

1 

0 

1 

0 

Regime 27 

0 

0 

1 

0 

0 

1 

0 

0 

1 


with the transversality conditions pi 2 (T) = p 2 i{T) = 0 
The solution to the above equations are 


Piiii) — ~ i) 

P2i{t) = {T-t) 
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Since pi2(f) = T — t > = ~ routing variable Q12 (f ) can not be unity 

Similarly P21 (f) = T—t > P2i{t) = and therefore the routing variable 0:21 (t) 

can not be umty. 

Regime 5 : 

In regime 5, the routing variables ai 2 (f) = 1/ a 23 (f) = 1/ and Q 32 (f) = 1 The 
dynamics of P23{t) and P32{t) are given as 

P 23 = — 1 -+■ CL23{P23 — P3z) 

P3Z — + <l32{p31 ~ P 23 ) 

With the transversality condition P23(T) = P32{T) = 0 

Thus P 23 {t) = P 32 (f) =T -t. Since pysit) = {T - t) > P 2 i{t) = 0 : 23(0 can 

not be unity. Similarly 0132(0 can also not be umty Thus regime 5 is mled out as a 
termmal regime. 


Regime 6 : 

ai2 = 1,0:23 = 1 and 0:31 = 1 The dynamics of pi2(0 and P 23(0 are given as 

P12 = -1 + ai2(Pi2 - P23) 

P23 = ~1 + Clzsipzs ~~ P34) 


with the transversality condition pi 2 (T) = P23^) — 0 
The solution for P23(0 is 


P23(0 


1 _ pa-ait— T) 2 — e“34(*~r’) ga-ait—T) _ ^a^it T) 

I — -I — 

023 ^34 023 ~ 034 


As proved in Theorem 4 3 3, the function P23(0 as given above is greater than p24(f ) 
m some mterval endmg with T Therefore the routing variable a 23 (t) can not be 
umty and regime 6 as a termmal regime is ruled out 
Regimes 7, 8 and 9 : 

Oc\2 = 1> = 1- 



The dynamics of pi2(t) is given as 

Pi2 = -1 + axzijpn -P24) 

with the transversality condition pi2(T) = 0 . 

The solution to the above is given as 

191, ft) = ^ ^ gan(t-r) _ ga24(4-r) 

*^12 a24 ai2 — 024 

Smce P12 (t ) as given by the above expression can not be less than pu (t ) m an mterval 
endmg with T, the routmg variable Q:i2(t) can not be unity Hence regimes 7, 8 and 
9 are ruled out as termmal regimes. 

Regime 10 : 

Ol 3 (^) = 1 / Q: 3 i(^^) = 1 - 

The dynamics of pnft) and psift) are given as 

Pl3 = -1 + <213(P13 -P3l) 

P31 = “1 + a3i(P3i -Pis) 

With the transversality condition piafT) = paifT) = 0 . 

The solution to the above is given as 

Pi3(t) = (T-t) 

P3l(t) = (T-t) 

Smce pisft) = T — t > Pu(t), the routmg variable aiz(t) can not be umty. Similarly 
the routmg variable 0:31 (t) can not be unity. Therefore regime 10 as a termmal 
regime is ruled out. 

Regime 11 ; 

The routmg variables aiz{t), 021 (t) 032(t) are umty m this case. The dynamics 

of pi3(t), P2i(t) and P32{t] are given as 


Pi3 — “1 + ai3(pi3 — P32) 
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P 21 — —14- a 2 i(p 2 i - Pn) 

P32 = -1-f 032(^32 -P21) 

with the transversality conditions piziT) = p2i{T) - P32{T) = 0 
The solutions to the above arepi3(t) = P2iit) = p32it) = T-t Smce puit) is greater 
than pu{t) , the routing variable 0:13 (t) can not assume a value equal to unity This 
holds true for the routmg variables a2i{t) and 0:32(0 too Thus regime 11 as a 
termmal regime is ruled out. 

Regime 12 : 

The routmg variables oi3(0/ O2i(0 and 034(0 unity. In regime 12, the costate 
variable pi3(0 satisfies the followmg differential equation 

Pl3(0 = -1 + ai3(Pl3 - P 34 ) 

With the transversality condition pi3(T) = 0 
The solution to the above equation is 

I _ 1 _ e“34(i-T') gai3(t-T) _ ga34(t-r) 

Pisit) = 1 1 

fli3 O34 ai3 ~ U34 

Smce the routmg variable Pi3{t) is greater than puit) ua an mterval endmg with T, 
the routmg variable 013(0 can not assume the value unity. Hence regime 12 as a 
termmal regime is ruled out. 

Regimes 13 and 16 : 

013 (t) and 031(0 unity m these regimes The costate variables pnit) and p3i{t) 

satisfy the followmg differential equations 

Pl3 = — 1 -t- Ol3(Pl3 — P3l) 

P31 = — 1 -t- 031 (P31 ~ P13) 

With the terminal conditions pi3{T) = P3i[T) = 0 

Pi3(0 = P2i{t) =T-t As argued earlier, pis (t) (P3i(0) is greater thanp3i(0 (Puit))- 
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Hence the choice of the value for the routing variables Q!i3(t) and as unity 
in an interval ending with T results in the violation of the optimality condition. 
Hence regime 13 and 16 are ruled out as terminal regimes 

Regime 14 : 

In regime 14 , the routmg variables uas and a32{t) are unity. By an analogous ar- 
gument as given above m the routmg variables a22{t) and asiit) and the costate 
variables p23(t) and p32{t) results m the fact that the choice of the value of umty 
for 0:23(0 and 0:32 (t) in an mterval ending with T violates the optimality condition. 
Thus regime 14 can not be a termmal regime. 

Regime 15 and 18 : 


In regime 15 and 18 , the routmg variables 0:13 (t) and 033(0 unity. The dynamics 
of pi3(0 is given as 

Pl 3 — — 1 + < 2 i 3 (pi 3 -P34) 


With the transversality condition pisiT) = 0 
The solution to the above equation is given as 


Pl3(0 “ h — 

013 <^34 013 ~ O34 


Smce pi3 (0 as given by the above expression is greater than pu{t) m an mterval end- 
mg with T, the choice of the value for the routmg variable 013 (f) as unity violates 
the ophmality condition. Hence the regimes 15 and 18 are ruled out as terminal 


regimes 


Regime 17 : 

The routmg variables au{t), 024(0 and 032(t) are unity The dynamics of i? 32(0 in 
regime 17 endmg with T is given as 

\ _ ga32(t-"T) ^ _ ga24(t-T) 

P 32(0 = 


032 


024 


e“32(t-T) _ 

H 

a^2 0-24 
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The function pszit) as given above is greater thanp34(t) in an interval ending with 
T and therefore the routing variable a^zit) can not be unity. Hence regime 17 is 
ruled out as a tenrunal regime. 


Regimes 19, 20 and 21 : 

In regimes 19, 20 and 21, the routing variables a 2 i{t) and au{t) are unity. The 
dynamics of P2i(^) is given as 


, , 1 - 1 
Pzi{t) = + 


Qau{t~T) QO.u{t-T) 

+ - 


021 rii4 021 — 0i4 

As argued earlier, the function P2i(t) as given by the above expression is greater 
than P24 (0 in an mterval endmg with T, the routing variable 021 (t) can not be unity. 
Hence the network operation can not end m regimes 19, 20 and 21 under the opti- 
mal routmg strategy. 


Regime 22 : 

In regime 22, auit) and 031 (t) are unity The dynamics of p3i(i) is given as 

1 _ e“3l{t-r) I _ gaH(t-T) ga3i(£-r) _ gai4(i-r) 

P 31 (^) ~ 1 ^ 

031 <^14 <^31 ~ ®14 

Since the function p3i(t) as given by the above expression is greater than p34(f) in an 
interval endmg with T, the routmg variable 031 (t) can not be unity. Hence regime 
22 IS ruled out as a termmal regime. 


Regime 23 : 

The routmg variables 023(0 and 032(0 are unity in regime 23. It is easy to verify 
that the costate variables p23(0 and pszii) are given as 

P23(0 = P32(0 —T — t 

Smce P23(0 (P32(0) IS greater than P24(0 (P34(0) choice of the value for routmg 
variable 023(0 (^32(0) as unity violates the ophmality condition. 
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Regime 24 : 

o. 23 it) and a 34 (t) are unity m regime 24 
The costate variable PTsit) is given as 

Pisi^) = 1 1 

023 O34 023 ~ O34 

Smce P 23 (t) IS greater than P 24 (i) m an interval ending with T, the routing variable 
a23(0 can not be unity. Thus regime 24 is ruled out as a terminal regime. 

Regime 25 : 

In regime 25, ctu and Q 31 are unity The costate variable p^i (t) is given as 

^ Q0.2i{t—T) g“3i{^— r) 

P3lit) 1 1 

^ ^ 031 ^14 O 31 — ai4 

Smce P 31 (t) IS greater than p 34 ,{t) in an mterval endmg with T, the routmg variable 
Q 31 (t) can not be imity Thus regime 25 is ruled out as a termmal regime 


Regime 26 : 

In regime 26, a 32 and azi are unity The costate variable 7132 (t) is given as 


Pziif) 


1 _ p<^ 32 {t-T) 1 _ pO-uit-T') Q<i3i(t-T) _ „a 2 i(t-T) 

t ! + ^: - + 


032 *^24 O32 — 024 

Smce P 32 (f) IS greater than P 3 i{t) m an interval endmg with T, the routmg variable 
Q 32 (t) can not be unity Thus regime 26 is ruled out as a termmal regime. 

□ 

Thus the network operation always ends m regime 27 under the optimal routmg 
strategy. In a regime 27 endmg with T, the costate variables are given as the 

followmg. 


Pl 2 (l) 

pisii) 


^ ^a\2(t—T) ^ ga2i(t—T) 

012 t^24 O 12 — 024 

_ g“l3(t-2’) ^ _ Qaait-T) o^uit-T) _ ga34(f-T) 


013 


+ 


+ 


O 34 


Ol3 — O 34 


(5 50) 
(5 51) 


014 


puii) — 


(5.52) 
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P2l{t) = 

P23{t) — 


P2i{t) 


1 _ 2 _ gfluCf-T) ga2iit-T) _ ^au{t-T) 

h — I — — ~ 

021 Ol4 <321 ~ <314 

1 _ 2 - 

1 1 

023 (334 (323 ~ ^34 

2 — g<'24(t-r) 


(5 53) 


(5.54) 


(5 55) 


P3i(i) = 
P32it) = 


Pu{t) = 


\ 2 — ^dsiit-T) _ QCLu{t-T) 

1 1 

asi au 0,31 <^14 

2 — ^0.32{t-T) 2 ~ Q<^ 2 i(t-T) Qa32{t-T) _ 

1 1 

<^32 ^24 CL 32 ^ ^24 

2 — 0*^34 (^-‘^) 


(5 56) 


(5 57) 


(5.58) 


Considler the situahon where in all the direct links in the network have the same 


value for the Imk parameter. In practical terms, this amoimts to the fact that the rate 
at which the Imks operates are the same for all the three direct Imks An interesting 
property of the optimal routmg strategy is that imder this situation, all the traffic 
arriving at the source nodes are routed onto the direct links and the alternate paths 
are never used for the entire duration of network operation 


Theorem 5.4.2 If all the direct links of the network have the same value for the link 
parameter, then the network operates in regime 27 for the entire duration [0, T] 

Proof : 

If ai4 = 024 = 034, then = Pi4{t) = pM Vt e [0,7] Corresponding to this 

situation the costate variables as given by the equations (5 50)-(5 58) satisfy the 
followmg relationships 

Pu{t) < 712 (t), vt€[o,r] 

714(0 < 713(0, Vf6[o,r]. 

724(0 < 721(0, VtG[ 0,T] 

724(0 < 723 ( 0 , vte[o,r] 

734(0 < 73 i( 0, Vf€[ 0,T] 

734(0 < 732(0, Vt€[ 0 ,T] 
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Hence the network operates in regime 27 for the enfare duration [0, T]. 

□ 

Consider the case wherem the direct links of the network are of different param- 
eters. Let us assume that the link (1,4) is ihe fastest of the three In other words 
ai4 > max{a 2 i, ^34} Then it can be easily argued that the terminal regime 27 can 
not be preceded by a regime m which the link (1,4) is not used for routing the 
mcoming packets at node 1. 

Theorem 5.4.3 Let au > max{a 24 , 034} Then the terminal regime 17 can not be preceded 
by regimes 1 to 18 

Proof : 

Smce ai4 > maa:{a24, 034}, it can be easily verified that the following relationships 
hold true for all t 6 [0, T]. 

2 — ga24(t-T) 

Pu{t) < 

024 

1 _ pO’Sid-T) 

Pu{t) < 

<334 

Since puit) and pisit) as given by the equations (5 50) and (5.51) m a termmal 
regime 27 are greater than P 24 {t) and P 34 {t) respectively for all t 6 [0, T] (as argued 
in the proof of Theorem 4 3 2), they are both greater than pu{t)i Vf G [0, T) For the 
termmal regime 27 to be preceded by any regime m which 014 (f) is equal to zero, 
either pi4(f) has to be greater thanpi2(f) oxpu{t) greater thanpi3(f) or possibly both. 
Smce this can not be the case under the condition stated m the theorem, regime 27 
can not be preceded by regimes 1 to 18, wherem 0:14 (t) equals zero Thus the only 
regimes that could possibly precede the regime 27 are 19, 20, 21, 22, 23, 24, 25 and 26. 

Remark 5.4.2 : Reasonmg exactly along the above Imes, it can be concluded that 
when Imk (2,4) is the fastest direct Imk, then the termmal regime 27 can not be 
preceded by regimes 1, 2, 3, 4, 5, 6, 10, 11, 12, 13, 14, 15, 19, 20, 21, 22, 23 and 
24 Similarly if Imk (3,4) is the fastest direct link, then the termmal regime 27 can 
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not be preceded by regimes 1, 1, 4, 5, 7, 8, 10, 11, 13, 14, 16, 17, 19, 20, 22, 23, 25 and 26. 


We now mvestigate m the next subsection, the possible mter regime transitions and 
the procedure to specify these regime transition mstants for the case wherem link 
(1,4) IS the_^stesf direct link. From the topological s}anmetry of the network, it can 
be seen that the arguments used in the next subsection can be easily extended to 
the cases wherein either Imk (2,4) or (3,4) is the fastest direct link. This being the 
case, the arguments for the latter cases are not repeated 


5.4.1 Links (2,4) and (3,4) of the same link parameter 

Consider the case m which the direct Imks (2,4) and (3,4) have the same Imk 
parameter and are both slower than (1,4). In other words, 024 = 034 < au 
In the termmal regime 27 the dynamics of p 23 (t) and p 32 (t) as given by Equations 
(5 54) and (5.57) can be written as the followmg : 

P23(t) = P 2 i{t) + fisit) 

P32{i) = P34(f) + / 32 (f) 


where the functions /23(f) and /32(f) are non-negative Therefore regime 27 cannot 
be preceded by any regime m which 023 (f) and/ or 032 (f) are unity Thus out of the 
8 regimes 19 to 26 listed above, the ones that could possibly precede the regime 27 
are 19, 21 and 25 only as shown m the three cases A, B and C m Figure 5.17 Let us 
examine the conditions on the link parameters of the network imder which these 
transitions take place, and also the implications of these conditions 



CASE A 




CASE C 


Figure 5 17 Possible regimes precedmg regime 27 when 024 — o.u< ^'^4 
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CASE A : 

Corresponding to the condition a2i — a34, the costate variables pziit), P2i{t) 
and p3i [t) in terminal regime 27 are given as the following : 


P2^{t) = P 34 (t) = 

024 

P2l(i) = + 


P 3 l(t) = 


021 
g« 3 i {i-T) 


(021 — O14) 


Oi 4 

\ _ g“l 4 (t-r) 

_| ^ 


(559) 
(5.60) 
(5 61) 


CI3I <ll 4 (03I ~ O14) 

For the termmal regime 27 to be preceded by regime 19 (m which 0:21 = Q31 = 1 ) at 
some instant it is necessary and sufficient that 

P 2 l{tsi) =P2i(t,,) 

PSlitsx) =P 3 iitsi) 

Since P2i{t) = Psiit), the above two conditions can be satisfied only if P2\{tsi) = 
/hi (Cl ) For this to be the case it is necessary and sufficient that 021 = 034 For the 
condition P2i(Ci) = /h4(Ci) to be satisfied for some 0 < < T, it is necessary and 

sufficient that 

1 _ e-“2i'r I _ Q-auT (e-“2ir _ g-^wT) i _ 

+ + ^ < P 24 ( 0 ) = - 


P2l(0) = 


021 <^h 4 (<^21 ~ CI14) 

The switching mstant Ci is obtamed by solvmg the equation 

014) 


024 


2 _ g“2l('3i -r) I 

+ _ 


4 - 


ga24(ia| -T) 


O21 ai4 (1121 ~ Ql4j <^24 

It can be argued along the following lines that the regime 19 which precedes regime 
27 has to be the startmg regime 

Note that the functions P21 {t) and P24 (t) can have at the most one pomt of mtersection 
in the mterval (— oo,T) (as proved m the Lemma 4 31 ) Same is the case with 
the functions p3i{t) and p2i(t) also. Therefore P2i(f) < P2i{t) and P3i(0 < P 34 (f)/ 
Vf G [ 0 , Cl] The relationships puit) < P23{t) and P3i(f) < P 32 (f) also hold true for all 
t < ts, as can be justified on the followmg grounds: 

In regime 19 , 


P23 


-1 - 4 - 023(7223 “ P 3 l) 
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= — 1 + <223(^23 - P 21 ) (since ;?2i = P3i) 

And P21 = — 1 + ci2i(P2i — 

P23 - P 2 I - 0,23 {P23 ~P 2 l)- 021 (P 21 “ Pu) 

= 023 (P23 ~P 2 i)- 021/21 (t) (where the expression /21 (t) > 0 , Vt 6 [ 0 , T)). 

Att — (Pisitsi) - P 2 iitsi )) > 0 The soluhon to the above differential equation is 
given as, 

{P23it) - P2i{t)) = (P23(i.,) -P2i(f3i))e“'"^‘"‘'‘^ - 

= (P23(i.,) /■' >/ 2 i(r)dT 


Since /223(f5i) - P2i(isi) > 0 / h can be observed that p 23(0 - P2i(f) > 0 , Vt < 
Similarly it can be argued that P3i{t) < p32{t), Vt e [ 0 , Thus the relationships 
P2i(f) = mm {p2i{t),P23{t),P2i{t)} and P3i(f) = min {p 3 i{t),P 32 {t),Pu{t)}, hold true 
Vf G [ 0 , fsj The relationship pu{f) = mm {puit) , Piiit) , Puit)} also can be veri- 
fied to hold true for all t < h, Hence the routmg variables ai4(t), a'2i(f) and Q3i(t) 
continue to be unity for all t < f Therefore regime 19 has to be the startmg regime. 

Thus, if the link parameters of the network are such that 021 = 031 and au > 
a 24 = 034, then the optimal routmg strategy for the composite four-node network 
is the same as synthesised from the locally optimal strategies for the units 1 and 3 , 
when they are considered in isolation The switchmg mstant can also be obtamed 
by solving the equation, 

l_e“ 2 dtn- 7 ’) 1 _ ga2i(«,i-r) _ gai4(t,i-T) ^ 

a2t Ou (<^21 ~ Ou) <224 

which IS the same as that for the mdividual units when they are considered m 

isolation 

Remark 5 . 4.3 : By analogous reasonmgs, it can be concluded that when the Imk 
parameters satisfy the followmg relationships, 
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(i) a24 > a34 — ai4 


(ii) ai2 = 032 


then optimal routmg strategy for the composite network is the same as that 
synthesised from those for the individual units 1 and 2 Correspondmg to this 
situation, the network starts in regime 8 and switches over to regime 27 if 


1 __ p-OjoT 1 _ p-a24T ^ p-a24T\ 

p,2(0)=:i-^ + + ^^-7: ^ < Pi4(0) 


1 - 

014 


012 ^24 (^12 - O24) 

The switching instant is obtamed from solvmg the equahon: 


^an{ts^~T) 

+ - 

012 


024 {<312 — 024 ) 


014 


Similarly if the Imk parameters satisfy the followmg conditions 

(i) 034 > 024 = Ol4 

( 11 ) 023 = Ol3 

the optimal routing strategy for the network is the same as that for the units 2 and 
3 when they are considered in isolation 


CASE B : 

For the regime 27 to be preceded by regime 21 m which P 2 i(t) < F24(t)/ it can 
be easily verified that the followmg two condihons together, are necessary and 

sufficient' 


(l) 021 > 031 


1 _ e(-«2iT) 1 _ e(--Hr) ^ e(-a2ir) _ ^ 1 - 

^ Oi4 021 - Oi4 024 

Remark 5.4.4 ; Condition (i) ensures that pn{t) > Vt e [0,T), and therefore 

if the functions pnfO and pnfO intersect, then the instant at which this takes place 
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(denoted as is less than where t,, is the instant at which p2i(i) and p2i{t] 
intersect The instant is the solution to the following equation 

I _ 2 - e“w(«-7’) ea2i{t-T) _ gan(t-r) ^ _ ^a^iit-T) 

^21 O.U (^21 — 014 ) 024 

The regime 21 might in turn, be preceded by other regimes. It can be argued 
along the followmg lines, that the only regimes that could possibly precede the 
regime 21 are regimes 19 and 20 In regime 21, the costate variable p2i{t) is given as 


P 2 l{t) 


021 Oi 4 (021 ~ O14) 

+ /21(f) where /21(f) > 0. 


The costate variable pi2(f) satisfies the followmg differential equation 


P12 — ~1 + Oi2(pl2 “■ P21) 

Since p2i > Pu P12 < — 1 + 0i2(pi2 — Pu) 

where pu — — 1 -h oupu 

Therefore pu - Pu < <^i2(Pi2 — Pu) ~ oupu 

< Oi2(pi2 - P14) 

Let Pi2(f)-m4(f) = 012(P12-P14) -/12(f) where /12(f) > 0. 
Then ipn{t) - Puit)) — (Pi2(f5i) - Pi4(fsi))e“‘^^* 

_g“i2(«-iji) f e'"“>2h-*n)yj2(T)dr 


Since (pi2(fsi) - Pi4(fsi)) > 0 and smce the second term m the above expression 
IS positive for all t < f,,, it can be concluded that regime 21 can not be preceded 
by any regime m which pi2(f) < Pu(f) (and consequently by any regime m which 
ai2(f) = 1) Furthermore, smce 034 < 014 the function P34(f) > Pu{t), for all t € [0, T) 
and therefore the regime 21 can not also be preceded by any regime m which ai3(f) 



5.4 Optimal routing in a four-node hub network 


204 


IS vinity. Thus in any regime that precedes the regime 21, the routmg variable q;i 4 (^) 
has to be unity. 

Since P 2 i{t) < pz 4 :{t) and pn[t) < pzsit) for all t < ts^, the value of the routmg 
variable Q' 2 i {t) also can not change. Therefore the only regimes that could possibly 
precede the regime 21 are 19 and 20 

Assume that the necessary and sufficient conditions for the regime 27 to be 
preceded by regime 21 are satisfied. Let us mvestigate the conditions under which 
the regime 21 is preceded by either 19 or 20 
I. Link parameter a^z < asi- 

Under this condition, it can be argued that the costate variables Pzz{t) and P 3 i(t) m 
regime 21 satisfy the relationship pzzit) > P 3 i{t)i Vt € [0, isj The arguments are as 
given below . 

In regime 21, the differential equations m the costate variable pzzit) and pzi{t) 
are the following . 


P32 = 

where pziit) = 


> 

P31 = 

> 

Therefore pzz — Psi < 
Let (p32-P3i) = 
Then Pszit) - Psiii) = 


— 1 + a32(p32 ~ Pll) 

][ _ ga2i(£-T') ^ _ gai4(£-T’) ^o,2i{t-T) _ 

1 - - 


CLll <^14 

1 __ pO,u{t-T) 

Pu{t) = 

014 

— 1 + 031 (p3i “ Pu) 


<321 <3i4 


— 1 + 032(^31 “ Pm) smce 032 < <231 
a 3 z{P 32 -P 3 l) 

azzipzz - P 3 i) - f{i) where f{t) > 0, Vf < 

J Zs^ 


= {P 3 iits,) - j'j" e (5.62) 


We know that 

PSlits^) 

P3\{U,) 


I _ ga32(<»i-3’) 


<332 


1 _ g“24(t5i-3’) 

_j 

024 

+ 

Oi4 


ga3i{t.i-T) _ ga24(t-ri 

"b ” 

O32 — <324 

ga3i(t,i-T) _ ga,4{f-r) 

+ 


<331 


O 31 — 014 
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Since a 32 < and 024 < ai4/ Pzi{ts^) > Pzi{tsi) Therefore the nght hand side of 
the Equation (5 62) is positive 'it < Thus regime 21 can not be preceded by 
any regime m which 032(0 = 1 This implies that regime 21 can not be preceded 
by regime 20 For the regime 21 to be preceded by regime 19, it is necessary that 
P 31 (0) < P34(0). The switching instant is given by the equation 

^ g^3l(^32"n) ^ ^ 014 ( 152 — r) — g®14(^a2""2^) 

1 1 = 

031 014 031 — Oi4 034 

Smce the relationships 

( 1 ) p3i(0 = ■rmn{p3i{t),p32(t),P3i(i)} 

(li) p2i{t) =7mn{p2i{t),P23{i),p2iit)} 

(ill) pi4(0 = Tmn{puit),pi3{t),pi2{t)} 

hold true it < ii,, the regime 19 must be the starting regime itself. Thus it can 
be observed that under this situation also, the optimal routmg strategy for the 
network can be synthesised from those for the mdividual imits 1 and 3 when they 
are considered in isolation. The inter regime transition for this case is shown in the 

Figure 5.18 

d? 

Figure 5 18. Inter regime transition diagram for the case ou > 024 = O34, 032 < 031 



IL Link parameter 032 > 031 : 

Let us examme all the possibilities under these conditions As mentioned earlier, 
let denote the mter regime transition mstant between regimes 21 and 27 To 
study the various possibilities, we focus our attenhon on the following conditions 

(a) and (b) given below 
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Condition (a) : pszits^) < 

1 e. the link parameters satisfy the inequality 


^32 a24 

032—024 



«31 ai4 


(5 63) 


azi-au 


Condition (b) : p32(0) < p3i(0) 

where P32{t) is the solution to the differential equation 

P32 = — 1 + 032(^32 — P21) with the initial condition 

1 — g“32(tai— r) 2 — g“2l(fji— 3^) g“32(iii— 3") 

P32{tsr) = ^ + + 


0-32 


<321 


<332 “ <324 


and P21 (f) is given by 
P 2 lit) = 


2 _ g“2l(i-3’) 2 — e“l'»(<-3’) ga2l(f-3’) _ gaij{<-3’) 

• + + 


(5.64) 


<321 <3 i 4 <321 ~ <314 

Tlie solution P32(f) of the above differential equation is given as 

P 32 (f) = + (1 — a 32 + 1/021 + I/O14) 

I 0l4032e°^^^‘-^~^^ („a24«-<..) _ ea32(i-tn)) 

02 l( 0 l 4 — 02i)(a2i — 032) 

<3210320“’'*^^''’ — e“ 32 (<-tsi)^ 

014(021 — Oi4)(Oi4 — 032) 
and therefore ^32(6) in the condition (b) is given by the following expression 

p32(0) = P32(ts,)e~“’^^‘'> -f (1 - e~“^-‘’')(l/<^32 + I/02I + 1/014) 

^ 0,140326°^^ ^^- 020 ., _g-a 32 <.,) 

02 l( 0 i 4 — 02l)(02l — 032) 

^021 0326““ (5 65) 

014(021 — Oi4)(ai4 — O32) 

If both the conditions (a) and (b) given above are satisfied, then the function 
P3i(t) > P32{t), Vf e [O.ts,]- This m turn implies that the regime 21 can not be 
preceded by regime 19 in which the routmg variable a3i(t) = 1 If pziiO) as given 
by the above expression is such that 

1 - e'“ 34 r 


P32(0) < P34(0) 


O34 
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then the network operation starts m the regime 20 and switches over to regime 21 at 
tsn where the switching mstant is obtamed from solvmg the equation P 32 {t) = P 34 {t). 
If P32(0) > P34(0), then it can easily be inferred that the network operation must 
have started m the regime 21 itself. 

Let condition (a) be satisfied but (b) is violated, le Psiits^) < Pziits^) but 
P32(0) > P3i(0) The following four cases 1, 2 and 3 given below exhaust all 
the possibilities 

Case 1 : P32(0) > P3i(0) > Pm{0) 

It can be easily inferred that regime 21 must be the starting regime 
Case 2 : p3i(0) < P34(0) andp32(0) > p34(0) 

It can be easily argued that regime 21 is preceded by regime 19 which is the starting 
regime The switching instant is obtained by solvmg the equation psi (i) = P34 (i) • 
Case 3 : 7131(0) < P34(0) andp32(0) < P34(0). 

Find the switching instant between p3i(f) and psiit) where pszit) is given by the 
Equation (5 64) Let this be denoted by tu Similarly let the switchmg instant 
between p3i(0 and p34(i) be denoted by tu and that between p^iit) and pu{t) be 
denoted by tz^. 

If tzi > ti 2 / then over [ti2, tzi] the network operates in regime 20, and this is preceded 
by regime 19 (which is the starting regme). The mter regime transition diagram 
correspondmg to this situation is shown m Figure 5 19. 

If t 24 < t\ 2 , then durmg the mterval [0, tu] the network operates m regime 19 



Figure 5 19 Regime transition diagram for the case tzi > t\z 


and over the interval [tu. tjJ the network operates m regime 21. The mter regime 
transition diagram is shown m Figure 5.20 
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Figure 5.20: Regime transition diagram for the case t 24 < tia 


Let condition (a) not hold true but (b) is satisfied, le. P 32 (tsJ > PsiitsJ and 
P32(0) < P3i(0). This implies that the functions P 32 (t) and P 3 i(t) intersect m the 
interval [0, tjJ Let tu denote this instant Then pz 2 {t) < P3i(0 m [0. tn] and 
P32(0 > P3i(0 in [ii 2 , Ifp 32 ( 0 ) IS greater than p 34 ( 0 ) then both the functions p 32 {t) 

and p 3 i(f) are greater than P 3 i{t) in [0, Therefore regime 21 must have been 
the starting regime If p32(0) is less than P34(0) then the followmg two possibilities 
arise: 

(i) P3i(0) > P34(0). This implies that the function P 3 i(f) is greater thanp 34 (t) in the 
interval [0, f,,] while p 32 (f) and P 34 {t) intersect Let us denote this instant as ^ 24 - The 
network operates in regime 20 during [0, t 2 i) , in regime 21 durmg [t 24 , and in 
regime 27 during [L, , T] as shown in Figure 5 21. 



Figure 5 21. The regime transition diagram for case (i) 


(ii) P 31 (0) < P34(0) The routing strategy can be specified as follows 
Find the instant when the functions P 3 i(t) and P32(0 mtersect Let this be denoted 
as denoted as fi 2 The instant of mtersection of psiiO 3-rid p 24 ,it be denoted as 
tu If ti 2 < hi/ (where ^24 is the mstant when P 32 (t) and puih intersect) then the 
regime 21 is preceded by regime 20 which is further preceded by regime 19 The 
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network operates in regime 19 during [0, tu], in. regime 20 durmg {tu. ^ 24 ]/ m regime 
21 durmg (^ 24 , ^6i] and m regime 27 (terminal regime) during as shown m 

Figure 5 22 



Figure 5 22- Regime transition diagram for the case ti 2 < hi 

If on the other hand, tn > t 2 i, then the regime 21 is preceded by regime 19 which m 
turn is preceded by regime 20. The network operates m regime 20 durmg [0, ^ 2 ], m 
regime 19 during (ti 2 , tui m regime 21 durmg (tu, t.,] and m regime 27 (termmal 
regime) durmg (i., , T] The regime transition diagram is shown m Figure 5 23 



Figure 5.23 Regime transition diagram for the case tn > hi 


If both the conditions (a) and (b) are violated then it can be seen that regime 21 

can not be preceded by regime 20. Either the network operation has started m 

remme 21 or m regime 19 The necessary and sufficient condition under which the 

network operation starts m regime 19 is given as 

1 _ p-o-3iT 1 - 1 - 

■ — -| 1 < 

03 ^ ai4 <^31 — ai4 034 

The switching mstant between regime 19 and regime 21 is obtamed by solvmg the 
following equation 

\ __ ga3i(t“-T) ^ _ ^au{t-T) ^ 


The above discussion exhausts all the possible regime transitions and specifies the 
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equations for the inter regime transition instants and therefore the optimal routing 
strategy for CASE B. 

CASE C : 

Because of the topological symmetry with the situation in CASE B, the arguments 
used there can be easily extended to this case also. This being the case, the argu- 
ments are not repeated m this sechon. Thus the necessary and sufficient conditions 
for the regime 27 to be preceded by regime 25 are the followmg : 

(i) asi > a2i. 

I _ g{-«3ir) 2 - _ A-auT) i - p(-“34r) 

(ii) + + 

^31 <314 (331 — (3 14 <334 

Condition (i) above ensures thatp2i(^) > Psiit), Vf G [0, T) and therefore the mter- 
section between p2i (t) and p 2 i{t) (if any) takes place at an mstant which is less than 
the mstant at which psiit] and P34(?5) intersect Furthermore, it can be argued that 
regime 25 can possibly be preceded by regimes 19 and 22 only m which the routmg 
variable 031 (f) is unity If the link parameters are such that 023 < azi then regime 
25 can not be preceded by regime 22 Correspondmg to this situation, either the 
regime 25 is the starting regime or is preceded by regime 19 
The additional necessary and sufficient condition for regime 25 to be preceded by 
regime 19 is given as 

2 — g~“2i3' 2 — 1 — 

1 j 

(321 (3i 4 (221 — <314 ^l24 

And the switchmg instant between regime 19 and regime 25 is obtamed by 
solving the equation 

2 g(^2l(^S2~^^ 1 g^l4{^a2”3’) g^2l(^S2 3*^ g(^14((j2~^^ 1 g«24(^i2 3) 

1 1 = 

021 (3i4 <321 “■ (3i4 <324 

The regime transition diagram for this case is shown m Figure 5 24 
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Figure 5 24. Regime transition diagram for the case G 23 < an 
When a23 > azi, consider the folio wmg two conditions : 


Condition (a) : P 23 (tij < PziitsJ i.e. the link parameters satisfy the inequality 


h ~ 




^23 


<234 


«23~”a34 


l_e°2ifai-r) x-e”i4an-^> 

> < / “21 “14 

a2i-ai4 


Condition (b) : p23(0) < P2i(0) where p 23 (^) is given as 

P23(t) = P23(t,Je““^‘-‘'i^ + (l-e“^(‘-‘>t))(l/a23 + l/a3i+l/ai4) 

, 0140236 ' .^g“ 3 l(t-< 5 ^i) _ g“ 23 (i-lai)^ 


031(014 - 03i)(a3i - 023) 

03i023e“i‘‘^*’i 




014(031 — 0i4)(0i4 — 023 ) 

and therefore P 23 ( 0 ) in the condition (b) above is given by the expression. 


(5 66) 


(5.67) 


031(014 — 03i)(a3i — a23) 

_^03i023e“''‘^‘''i~^^(e“*^*^'"‘''il — e“23(-'n)) 

014(031 — 014) (ai4 - 023) 

If both the conditions (a) and (b) given above are satisfied, then the regime 25 can 
not be preceded by regime 19 If P 23 ( 0 ) as given by the above expression is such 
that 


1 — 

P23(0) < P24(0) = 

O 24 

then the network operahon starts m regime 22 and switches over to regime 25 at tj, 
where the switchmg mstant h, is obtamed from solvmg the equation p 23 (t) = P 2 i' i]- 
If P23(0) > P24(0), then the network operation must have started m regime 25 itself. 





5.4 upiimai luuui jy ni 

Let condition (a) be satisfied but (b) is violated. Then the following three cases 
exhaust all the possibilities ' 

Case 1 : P23(0) ^ ^ /i24(0). 

It can be easily inferred that regime 25 is the starting regime 
Case 2 : P2i(0) < P24(0) and P23(0) > ^ 24 ( 0 ) 

It can be easily argued that regime 25 is preceded by regime 19 which is the 
starting regime. The switching instant t,, can be obtamed by solvmg the equation 

P2l(i) = P24(0* 

Case 3 : P2i(0) < PzM P23(0) < P24(0) Corresponding to this situation the 
optimal routing strategy can be specified as follows 

Find the switching mstant between p 2 i{t) and pn{t) where P23{t) is given by the 
Equation (5 68). Let this be denoted by fis Similarly let the switchmg mstant 
between P 2 i (0 and P 24 (f) be denoted by ti4 and that between P23{t) and pu{t) be 
denoted by If ^34 > then durmg the mterval [fis, t34] the network operates 
in regime 22, and this is preceded by regime 19 (which is the startmg regime) The 
regime transition diagram is shown in Figure 5 25. 



Figure 5 25. Regime transition diagram for the case tsA > hs 

If (34 < ( 13 , then during the interval [0, t»], the network operates m regime 19 and 
over the mterval [(m, (.,1 *e network operates m regime 25. The regime transition 
diagram for this case is shown m Figure 5.26. 



Figure 


5 26 Regime transition diagram for the case tsi < hs 
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Let condition (a) not hold true but (b) holds true le plaits,) > and 

P23(0) <P 2 i( 0 ) This implies that P23(0 and p 2 i(t) intersect m the interval Let 

f 13 denote this instant Then p23 (0 < P 21 {t) m [0, t^] and pz 3 it) > P 2 i{t) in If 

P 23 ( 0 ) is greater than p 24 ( 0 ) then both the functions pzsit) andp 2 i(f) are greater than 
P 24 (i) in [0, Therefore regime 25 must have been the starting regime If P 23 ( 0 ) is 
less than P 24 ( 0 ) then the following two possibilities arise 

(i) P2i(0) > P24(0) This implies that the function p 2 i(f) is greater than p 2 i{t) m the 
mterval [0, while pzzit) and p 2 i{t) intersect. Let us denote this mstant as 
The network operates m regime 22 during [0, tu) ■ During the mterval [f 34 , the 
network operates in regime 25 and during [hj, T] the network operates m regime 
27. The regime transition diagram is shown in Figure 5.27. 



Figure 5.27- The regime transition diagram for case (i) 

(ii) P 21 (0) < P24(0) The routing strategy can be specified as follows 
Find the instant when the functions P 2 i(t) and pzsit) intersect Let this be denoted 
as denoted as ^ 3 . The instant of intersection of piiit) and pziit) be denoted as 
tu If In < I 34 / (where I 34 is the instant when p 23 (I) and p 2 i{t) intersect) then the 
regime 25 is preceded by regime 22 which is further preceded by regime 19 The 
network operates in regime 19 durmg [0, fn], in regime 22 durmg (hs, ^ 34 ]/ m regime 
25 during (^ 34 , hj and m regime 27 (terminal regime) durmg The regime 

transition diagram is shown m Figure 5.28 If on the other hand, hs > I 34 / then 



Figure 5.28- Regime transition diagram for the case hz < H 


the regime 25 is preceded by regime 


19 which m turn is preceded by regime 22 
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Figure 5.29: Regime transition diagram for the case 

The network operates in regime 22 during [0, tn], in regime 19 during (ii 3 , ti 4 \, in 
regime 25 during and in regime 27 (terminal regime) during {ts^,T]. The 

regime transition diagram is shown in Figure 5.29. 

If both the conditions (a) and (b) are violated then it can be seen that regime 25 
can not be preceded by regime 22. Either the network operation has started in 
regime 25 or in regime 19. The necessary and sufficient condition under which the 
network operation starts in regime 19 is given as 

1 j g~“i4n g—O'iiT — g—O'u'r 

1 1 < . 

^21 <2i4 021 ~ <214 <^24 

The switching instant between regime 19 and regime 25 is obtained by solviag the 
following equation : 

1 _ 1 — g“14('-2") \ — g“24(i-7’) 

[- 1 — < ■ 

(121 ‘^14 “^21 ~ ^14 “24 

The above three CASES A, B and C exhaust all the possible regime transitions 
when link (1,4) is the fastest direct link and the links (2,4) and (3,4) are of the same 
parameter. From the above discussion, the following two conclusions can be drawn 
for this case au > 024 = <234 : 

• Traffic arriving at node 1 is routed onto the direct link (1,4) for the entire 
duration of network operation. 

• The network operation never enters regime 23, 24 and 26. This implies that 
traffic arriving at node 2 is never routed through the set of links {(2. 3). (3. 4)} 
to the destination. Similarly traffic arriving at node 3 is never sent on the 
set of links {(3, 2). (2. 4)} to the destination. This is in accordance with our 
intuition since the links (2,4) and (3,4) are of the same link parameters. 
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The arguments employed in the above discussion to obtain the various inter regime 
transition instants can be extended to the two other cases and it can be concluded 
that when link (2,4) is the fastest direct link and links (1,4) and (3,4) are of the same 
parameter, then the link (2,4) is used for the entire duration of network operation. 
For this choice of the link parameters the network operation never enters regimes 
16, 18 and 25. Similarly when link (3,4) is the fastest direct link with links (1,4) and 
(2,4) of the same link parameter, then the network operation never enters regimes 
3, 9 and 21. Link (3,4) is used for the entire duration of network operation. 


5.4.2 Link (1,4) slower than (2,4) and (3,4) 


Consider the situation wherein the link (1,4) is slower than links (2,4) and (3,4) 
(which have the same parameter), i.e. au < 024 = < 334 - 

It is easily verified that under this situation the following relationships hold true: 


Pu{t) = 


1 


^au{t-T) 

au 

P2i{t) 

P2i{i) 

P34(i) 

PSiit) 


> P24(f) = — ^ vtG[o,r). 

<324 

< P2\{t) VtG[0, T). 

< P23{t) VtG[0,T). 

< P3i(t) VtG[0, T). 

< P32(t) VtG[0, T). 


Therefore the terminal regime 27 can not be preceded by any regime in which 024 (i) 
and/or 0 : 34 (t) is zero. Thus the regimes which could possibly precede the regime 
27 are 9 and 18 only. In regime 9, the routing variable auf) is unity. A necessary 
condition for regime 27 to be preceded by regime 9 is that an > < 3 i 3 - This condition 
ensures that pi 2(0 < Pn{t) in the interval [0. T) and therefore cxnit) is zero for the 
entire interval of operation. The following (additional) condition is sufficient for 
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the network operation to start in regime 9 and switch over to regime 27 : 


Pl2 ( 0 ) 


,~n,;r 


+ 


1 — g~“247’ _ g-a24r 


-f 


< Pl4(0) = 


1 - 


0.12 024 012 — 024 ’ <^14 

A necessary condition for regime 27 to be preceded by 18 is 013 > au- The following 
(additional) condition is sufficient for the network operation to start in regime 18 
and switch over to regime 27. 


Pl3(0) 


g — 2 g'-“34^ ^ — 034 ^ 


-ai^T 


+ 


+ 


< Pl4(0) 


1 - 


Oi3 034 Oi3 — 034 *^14 

By analogous arguments, when ou = 024 > 034 the network operation can possibly 
start either in regime 25 or 26 only. The necessary and sufficient conditions for the 
network operation to start in regime 25 are 


(i) 031 > O32 


■1 g{-<i. 3 iT) 2 — g(~“n2") g("-“31^) — g(~“14^) 1 — 

(ii) ^ + + < 


034 ^) 


0.31 0X4 O31 — Oi4 *^34 

The necessary and sufficient conditions for the network operation to start in regime 
26 are 

(i) 032 > 031 

^ g(— “ 32 ^) \ g(— “ 247 ’) g(— “ 327 ’) — g{-0.2iT) 1 6 ^ ^ ^ 

<224 ^ 032 - 024 “34 

For the case wherein 014 = 034 > 024/ the terminal regime 27 can possibly be 
preceded by regimes 21 and 24 only. The necessary and sufEcient conditions for 
the network operation to start in regime 21 are 


(i) O21 > 023 


(ii) 


J-aziT) l_gi-auT) g(-a2,T) _ g(-auT} 1-e 

1 + 2 I + < 


.(-“24r) 


021 “14 021 - 014 “24 

The necessary and sufficient conditions for the network operation to start in regime 
24 are 
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(i) 023 > <221 

(ii) ^ ^ 1 - e(-°Br) _ ^j-a^T) ^ ^ 

<^23 034 <223 — 034 ^ a24 

From the above discussion the following conclusions can be drawn regarding the 
optimal routing strategy for the case wherein link (1,4) is slower than hnks (2,4) and 
(3,4) (which have the same link parameter) : 

• The traffic arriving at the nodes 2 and 3 are routed onto the direct links to the 
destination for the entire duration of network operation. 

• Traffic arriving at node 1 is never routed through the set of links {(1, 2), (2. 4)} 
if the link (1,2) is slower than link (1,3). 

• The traffic at node 1 is never routed through the set of links {(1, 3), (3. 4)} if 
the link (1,3) is slower than link (1,2). 

5.5 The direct links with different parameters 

Consider the case where the direct links have different link parameters. Let us 
assume that au > <224 > 034. Because of the topological symmetry of the network 
the arguments in this section applies to the other cases in an exactly similar manner. 
Let us investigate the possible regime transitions and the equations to obtain the 
switching instants. 

Since au > 024 > 034, by Theorem 5.4.3, the terminal regime 27 can not be preceded 
by regimes 1 to 18. Furthermore since 024 > 034 

P2i{i) < Pu{t) VfG[0, T) 

Pnit) > Pi^{l) VtG[0,T) 

Therefore regime 27 can not be preceded by regimes 22, 23 and 24 in which 023! D 
is unity. Thus the regimes that could possibly precede the regime 27 are regimes 
19, 20, 21, 25 and 26 only. Let us consider each of these possibilities in detail. 
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In regime 19, the routing variables a; 2 i(t) and a 3 i(t) are unity. For the regime 27 to 
be preceded by regime 19, it is necessary that the functions ft, (f ) and p,. (() as given 
by the Equations (5.53) and (5.55) intersect at some . It is also necessary that the 
functions P 3 ,(t) and ft 4 (t) as given by the Equations (5.56) and (5.58) intersect at the 
same instant tj,. Furthermore at t the function P 32 (t) has to be greater than 
7 ^ 34(0 so that regime 27 is not preceded by regime 20. Thus the set of necessary and 
sufficient conditions under which the regime 27 is preceded by regime 19 are given 
below : 


(i) P2l(0) < P24(0) 

(ii) P3l(0) <P34(0) 

(iii) Let be the instant at which ■p 2 i{t) = Puit). Then P 3 i(ts,) = pu{tsi) and 
P32(isi) >Pu{ts,)- 


The above conditions when stated in terms of the link parameters are as follows: 

(5.69) 


1 1 


<221 


ai4 


021 — <2 i 4 


2 — g~“.3i2' 2 — e~°-2iT g-“3l2’ _ g-aur 


031 


+ 


014 


+ 


<231 — <214 


< 


024 

1 - 

<234 


2 g^3l(2ai~r') 2 gi^l4(2ai “2*) g^3l(^ai~2’) — r) 2 — gl^34(^31 2^) 

+ + — 


<2-31 


Oi4 


<231 ~ <2 i 4 


034 


2 g“32(^3l— n) 2 g“24{^3] -2’) g“24(i3i— r) 2 — g°-34{tsi-T) 

+ + > 


^232 


024 


0-32 — <224 


(234 


(5.70) 

(5.71) 

(5.72) 


where tj, is obtained by solving the equation 


2 2 g<^14{(sj~r) 2’) gi3l4(tsj r) 2 — gi^24{(3^ 2^) 

+ + = (5.73) 

021 <214 <221 — <214 Oz 4 

It can be verified that the relationships pi 4 (t) =min {pi2(i),Pi3(i),Pi4(^j} andp 2 i(t)= 
min {p2i(0'P23(0,P24(0} hold true Vt < ts^ and therefore regime 19 can not be 
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preceded by any regime in which auit) and/or Q 2 i (0 is zero. Thus regime 19 
can possibly be preceded by regime 20 only. For the condition (5.72) above to be 
satisfied, it is sufficient though not necessary that 031 > 032 (this along with the 
relationship > 024 ensures that p 32 (f) > p 3 l(^), Vt € [0,r)). If this is satisfied 
then the regime 19 can not be preceded by regime 20 and therefore has to be 
starting regime. If on the other hand, this condition is violated then a necessary 
and sufficient condition for regime 19 to be preceded by regime 20 is ^ 32 ( 0 ) < P 3 i( 0 ). 
The equation for pzzit) in regime 19 is given as 

P32{t) - + (1 - ( 1/032 + l/ozi + l/ou) 

ai4a32e“^i(‘^i“^^ 


02 l(oi 4 - O2l)(o21 — O32) 

014(021 — 014) (ai 4 — 032) 

and therefore ^ 32 ( 0 ) is given by the following expression : 

^32(0) = P 32 (^sj)e~“^^^''' + (1 - + I/02I + 1/^14) 

0140326“"* 


(5.74) 


+- 


(5.75) 


^g-“2ltsi _ 

02 l( 0 l 4 — 02l)(o2i — O32) 
a2i - e°32(-^)) 

014(021 — Oi 4 )(ai 4 - O32) 

The instant of switching between the starting regime 20 and the intermediate 
regime 19 is obtained by solving the equation ^ 32 (^ 52 ) ~ PziiS's-i) w’here P 32 d) and 
P 31 {t) are given by Equations (5.74) and (5.56) respectively. 

The conditions under which the regime 27 is preceded by regime 20 can also be 
easily argued out to be the following: 

(i) P2l(0) < P24(0) 

(ii) P32(0) < P34(0) 

(hi) Let fsi be the instant at which p 2 i(t) = Puit)- Then P32(L,) = P 34 (L. ) and 

P3l(isi) > P34(Li)- 
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It can also be inferred that regime 20 can possibly be preceded by regime 19 
only. The additional necessary and sufficient condition under which the network 
operation starts in regime 19 is that psi (0) < ^32(0) where the expression for jd 32(0) is 
the same as in Equation (5.75). The switching instant between the starting regime 
19 and intermediate regime 20 is obtained by solving the equation p32(tsj = 
where P 22 {t) is given by Equation (5.74) and p3i(t) is given by the Equation (5.56). 
The conditions under which the terminal regime 27 is preceded by regime 21 can 
be stated as follows: 

(i) P2l(0) <p24(0) 

(ii) Let be the switching instant between P 2 \{t) and puit). Then pz\{ts^) > 

P34(!'.si) andp32(ts,) >P34(ts,). 

It can be verified that the relationships pi4(t)=min {pn{t),Pi3{t),Pu{t)} and pziit) 
= min {p 2 i{t)pP 23 {t),P 2 i(t)}, hold true Vt < Therefore regime 21 can not be 
preceded by any regime in which 014(1) and/ or Q2 i( 1) is zero. Thus regime 21 can 
be possibly be preceded by regime 19 and 20 only. The conditions under which 
regime 21 is preceded by 19 are the following : 

(i) p3i(0) < P34(0), where p3i(l) and p^it) are given by the Equations (5.56) and 
(5.58) respectively. 

(ii) Let the switching instant between the functions P3i(l) and ^34(1) be at t = 

The value ofpzzitsz) has to be greater thanp34(ls,). 

The second condition above ensures that regime 21 is not preceded by regime 20. 
The regime 19 can in turn be preceded by regime 20. The necessary and sufficient 
condition for this to take place is P32(0) < P3i(0). Since the functions psj'i) and 
P31 (1) can have at the most one point of intersection in [0, l^,], the regime 20 has to 
be the starting regime. 

The conditions under which the regime 21 (that precedes the regime 27) is preceded 
by regime 20 can be stated as follows: • 
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(i) P32(0) < p^(0) where and p^{t) are given by the Equations (5.74) and 
(5.58) respectively. 

(ii) Let the switching instant between the functions pzz{i) and pu{i) be at f = ts^. 
Then p 3 i (t^J has to be greater thanp 34 (tsj. 

The regime 20 will be preceded by regime 19 if p3i(0) < P32(0). The instant of 
switching is given by the solution to the equation p 32 (t) = P3\{t). 

The necessary and sufficient conditions under which the regime 27 is preceded by 
regime 25 are the following : 

(i) P3l(0) < P34(0) 

(ii) Let the instant at which the functions P 3 i('^) and p 3 A{t) intersect be at Then 

P32(^sJ > 'Pu{ts,) andp2l(^5,) >P24(L,)- 

The second condition above ensures that the regime 27 is not preceded by regimes 
20 and 19. The relationship pu{t) = min {pii{t),pn{t).pu{t)} can be verified to hold 
true Vt < tsj. Since the function p 3 i(t) is less thanp 34 (t)/ 'it < the regime 25 can 
not be preceded by regimes 21 and 24 in which 034(0 is unity. It can be concluded 
that the regime 25 can not be preceded by regime 23 from the following arguments. 
Assume that regime 25 is preceded by regime 23 and let the instant of transition 
between regimes 25 and 23 be at t = Oj* Then P3i{ts2) — P3z{ts2) and ^ 23 (^ 2 ) “ 
Pi-iiisi)- Iri regime 23 the dynamics of PTsit) and psiit) are given by : 

P 23 = “1 + 023(^23 - P 32 ) 

P 32 = — 1 + 032(^32 ~ P 23 ) 

Therefore (pzs — P 22 ) = ('^23 + 0 ^ 32 ) (P 23 ■" P 32 ) 

Hence pzsit) — Pszit) = (^ 23 (^ 52 ) “ ^ 32 (^ 2 ))^^ 

If P 23 (!.J - P 32 (t„) = 0, then (Mt) - P3i{t)) = 0, Vf < t., and consequently both 
the functions pa{t) and pn{t) have a slope equal to -1 in regime 23. If such is the 

case then 


Pl3{t) = — P23(fs2) — {t — tjj) — Pliitsj) ^ 82 ) 
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ButpasfO as given by the above expression is greater than p24(t) for alii < Hence 

the routing variable 023 (f) can not be unity which contradicts the assumption that 
the network operates in regime 23. 

If P23(^6-;) < P32{ts.) then it can be concluded that the slope of p 23 {t) is less than -1 
and cor\sequently 


P23{t) > Pliitsj) - (t - ts,) > P24it) 

and this leads to the same contradiction as above. 

If PTsits.) > Psiitsz) then the slope oip 3 i{t) is less than -1 and therefore we get 

Psiit) > Psiiisi) - (t - 
> P3i{t) yt<ts^ 

Corresponding to this situation the routing variable 0 : 32 (t) can not be unity which 
again contradicts the assumption that the network operates in regime 23. 
Therefore regime 25 can not be preceded by regime 23. Thus the only regimes that 
could possibly precede regime 25 are regimes 19, 20, 22 and 26. The necessary and 
sufficient conditions for the regime 25 to be preceded by regime 19 can be stated as 
follows : 

(i) P3i(0) <P34(0) 

(ii) Let the switching instant between p 3 i(t) and P 34 (i) be at t Then psiiisi) 
has to be greater thanp 34 (ts 2 ). 

Condition (ii) ensures that the regime 25 is not preceded by regime 20 or regime 
26. The instant of switching between the regime 19 and 25 is obtained by solving 
the equation p 3 i(f) = P 34 (f) where p 3 i(^) and^ 534 (f) are given by the Equations (5.56) 
and (5.58) respectively. The regime 19 in turn may be preceded by other regimes. 
Let us investigate the various possibilities. 

The arguments which were used to prove that the regime 23 can not be preceding 
regime 25 can be extended to show that regime 19 also can not be preceded by 
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regime 23. Since p 34 {t) > p 3 i{t) for all f regime 19 can not be preceded by 
regimes 21 and 24 in which 0:34 (f) is tinity. Similarly regimes 25 and 26 (in which 
024(0 is unity) can not be preceding regime 19. Thus the only two regimes that 
could possibly precede regime 19 are 20 and 22. In regime 19, the equations for 
p 32 {t), and P23(0 are given as the following: 


P32(0 = ^ 32 (^ 52 )®°^^^*'^ + (1 — *^2))(l/ 0-32 + 1/ 021 + 1/ Ou) 

<22i(<314 ~ '22i)(^3;21 

014(021 — Oi4)(Oi4 ^ O32) 


where P 32 {ts 2 ) is given as 


P32{ts2) 


^32 


024 


O32 — O24 


P23(0 = + (1 - ‘’‘^)(l/a23 + l/asi + IM 4 ) 

Q14^23^ ^ j 

a3i{<^u - <^3:)(<^3i - ^^ 23 ) 

^ 14(031 - ai4)(ai4 - 0123 ) 

where P 23 ( 0 i) is given as 

1 _ Q<422{ts,-T) I _ ga34(i»i-r) ga23(t.i-r) _ e°34(t.i-r) 

P23(fsi) = *■ 023 ~ <234 

Consider the following four cases : 

Case 1 : P23(0) < P2i(0) andp32(0) > P3i(0). 

It is easy to infer that in this situation the regime 19 is preceded by regime 22 
(which is the starting regime) and the switching instant between regime 22 and 19 
is obtained by solving the equation pnit) = Piii^)- 
Case 2 ; P23(0) > P2i(0) andp32(0) < P3i(0). 

The regime 19 is preceded by regime 20 (starting regime) and the switching instant 
between regimes 20 and 19 is given by solving the equation P32(t) = P3i(t)- 
Case 3 : P23(0) > P2i(0! and p32(0) > P3i(0)- 
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The regime 19 itself is the starting regime. 

Case 4 : pzi{0) < P2i{0) and ^32(0) < ;?3i(0). 

Let the switching instant between p2i(i) and ^(0 be denoted by % and let that 
between ^32(0 and p 3 i(t) be denoted by If > tn, then the regime 19 is 
preceded by regime 22 (which is the starting regime), while if tn > tn then the 
regime 19 is preceded by regime 20 (starting regime). 

As mentioned above, the regime 25 could possibly preceded by regime 20. The 
necessary and sufficient condition under which regime 25 is preceded by regime 
20 can be stated as follows : 

(i) P32{0) > P3i(0) where p 32 (t) and p 3 i(t) are as given by Equations (5.57) and 
(5.56) respectively. 

(ii) P2i{0) < P2ii0) where p2i(0 is given by the Equation (5.53). 

(iii) Let the instant of switching of P32(f) and p 3 i{t) be at t = t^^. Then p2iiLj) = 

^24(^52)- 

Such a regime 20 which precedes regime 25 has to be the starting regime. 

The other two regimes that could possibly precede regime 25 are regimes 22 and 
26. The necessary and sufficient conditions for regime 25 to be preceded by regime 
22 are the following : 

(i) P23(0) < P24(0) where p 23 {t) and p 24 {t) are given by the Equations (5.76) and 
(5.55) respectively. 

(ii) Let the switching instant between P 23 {t) ( as given by the Equation (5.76)) and 
Pziit) (as given by the Equation (5.55)) be denoted by t^^. Then it is necessary 
that piiits^) is greater than ^24(^52)- 

(iii) Att = ts,, P 32 {t) (as given by the Equation (5.57)) is greater than pz: t) (as 
given by the Equation (5.56)). 

The condition (ii) above ensures that regime 25 is not preceded by regime 19 and 
20 and condition (iii) ensures that regime 25 is not preceded by regime 26. 
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The regime 22 may in turn be preceded by regime 19 (It can be argued that the other 
regimes can not precede the regime 22). The necessary and sufficient condition for 
the regime 22 to be preceded by regime 19 is that P2i(0) < P23(0) where P 23 (t) 
is given by the Equation (5.76) and p 2 i{t) is given by the Equation (5.53). The 
switching instant between the regimes 22 and 19 is obtained by solving the 
equation p23(t) = P 21 (f)- 

The only regime which could possibly precede the regime 19 above is regime 20. 
The necessary and sufficient condition for this to take place is that ^32(0) < p3i(0) 
where psi {t) is given by the Equation (5.56) and p32(f) is given below. 

P32W = P 32 (f.,)e““"'‘-»’ + (l-e*“<'“‘->’)(l/a 32 + 1 / 021 +l/<lu) 

, 0H032e*”“o-"'> -,..1 _ ^.,,(.-1,,)) 

^21(^14 — <^2:)(a2i — ^32) 

o^uiciii — o.u){0'U ~ 032) 

To obtain Psiits^) m the above equation, note that during the interval [f 53,^52]/ the 
dynamics of P32(f) is given as 

Pn{i) — — 1 + o-3i{pzi — P 23 ) 

where pizit) is given by the Equation (5.76). Therefore ^>32(^53) is given as 

^32(^53) = ^32(^52)^'"^^^^“^”^’^^ + (1/^32 + 1/023 + 1/ 03l)(l - ‘»2)) 

^ (ga23(^-t02) / ai4a23e°-^‘^^--~^^ 

(023 — 032) V'^SlCow ~ 03i)(a23 — O31) 

03ia23e“-*'^’i~^^ ') 

+ P23(f.,) - (1/023 + 1/031 + 1/014) - tt„{a3,'_ au)(a,4 - 0231 j 
a32e“iim-‘.i)a,4a23e°”<‘-i~^’ 

(031 — 032)031(014 — 03i)(03i — O23) 

(ai4 - 032)014(031 — Oi4)(Oi4 — 023) 


In the above equation P 23 (tsJ and P 32 {ts 2 ) are obtained by evaluating the Equations 
(5.54) and (5.57) at the corresponding instants. 
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The switching instant between the regime 20 and regime 19 is obtained by 
solving the equation p32(f) = psiit) where pszit) is given by Equation (5.77) and 
P2i{t) is given by Equation (5.56). 

The above discussion ends the case where in regime 25 is preceded by regime 22 
and which in turn is preceded by other regimes. Let us now investigate the case 
wherein the terminal regime 25 is preceded by regime 26. 

The necessary and sufficient conditions under which the regime 25 is preceded by 
regime 26 can be stated as follows : 

(i) p32(0) < P3i(0) where pzzit) and p 3 i(t) are given by the Equations (5.57) and 
(5.56) respectively. 

(ii) Let denote the instant at which the functions psiit) and p 3 i{t) as given by 
the Equations (5.57) and (5.56) intersect Then 

(a) P23{tsi) >P 2 i{ts 2 )ii) 

(b) Piiitsi) > P2i{is2){t) 

where pzs (t) and p2i (t) are given by the Equations (5.76) and (5.53) respectively. 

If both the conditions (i) and (ii) above are satisfied, then the regime 25 is preceded 
by regime 26. It can be argued that the relationships 

(i) pi^it) = min {pu{t),puit).Pi3{i)} 

(ii) P32it) = min {p3i(i),P32(f)>P34(f)} 

hold true Vt < ts^. Therefore regime 26 can not be preceded by any regime in 
which the routing variable Q:u(t) and/ or 0:32(0 zero. Thus the only regime that 
could possibly precede the regime 26 is regime 20. It can be inferred that the 
necessary and sufficient condition for the regime 26 to be preceded by regiir.e 20 is 
that p2i(0) < p24(0) and the switching instant between the regimes 26 ar.d 20 is 
obtained by solving the equation P21 (t) = P 2 i{t) ■ Here pzi (0 and pziit) are gi'- en by 
the Equations (5.53) and (5.55) respectively. It can also be easily argued that such a 

regime 20 has to be the starting regime. 
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The above discussion exhausts all the possibilities when the temrinal regime 27 
is preceded by regime 25. So far, we investigated the cases wherein regime 27 is 
preceded by regimes 19, 20, 21, 22 and 25. Let us now examine the case wherein 
the regime 27 is preceded by regime 26. 

The necessary and sufficient conditions for the regime 27 to be preceded by regime 
26 are the following : 

(i) P32(0) < P34(0) where pszit) and p 34 {t) are given by the Equations (5.57) and 
(5.58) respectively. 

(ii) Let the instant at which the functions P 32 (f) and P 3 i{t) intersect be at tsy Then 

(a) P 2 l( 0 ) >P24(0) 

(b) P3l(0) > P34(0) 

The regime 26 may in turn be preceded by other regimes. Based on the properties 
of the costate variables (which we have so far exploited), it can be argued that the 
only regimes that could possibly precede the regime 26 are regimes 19, 20 and 25. 
The necessary and sufficient conditions for the regime 26 to be preceded by regime 
19 are the following : 

(i) p3i(0) < P32(0) where p 3 i(t) and pz 2 {t) are given by the Equations (5.56) and 
(5.57) respectively. 

(ii) p2i(0) < P24(0) where P 21 (it) andp 24 (^) are given by Equations (5.53) and (5.55) 
respectively. 

(iii) Let the instant at which the functions P 3 i(t) and P 3 i{t) intersect be denoted 
by tsy It is necessary that P 2 i(^) and P 2 i{t) mtersect at the same instant, i.e. 
Vllits,) ='P2A{ts^)- 

If all the three conditions stated above are satisfied, then the regime 26 is preceded 
by regime 19. The instant of transition between regimes 19 and 26 is obtained by 
solving the equation pziit) = P 2 i{i)- Such a regime 19 can in turn be preceded by 
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other regimes. Based on the properties of the costate variables in such a regime 
19 (that precedes the regime 26), it can be argued out that the only regimes that 
could possibly precede the regime 19 are 20 and 22. The necessary and sufficient 
condition for the regime 19 to be preceded by regime 20 is given as 

• P 32 ( 0 ) < P 3 i( 0 ) where the expression for p 32 ( 0 ) given as 


P32(0) = + (1 - e ““‘’z) (1/032 + 1/^21 + l/ou) 

ai4a32e“2i(‘>2-2’) 


02i(<214 — (^2l)(<^21 — O 32 ) 

/> ■'i'; 

0'li((l21 ~ fll4)(<2l4 “■ 0,32) 

and P 32 {fs 2 ) the above Equation (5.78) is given as 




(5.78) 


^ 32 (^ 53 ) — 


1 _ pO,2;i{ts2-’T) 2 __ ga24(ia2-T’) _ ^^^24(^52 

+ + 


The expression for p3i(0) is given as 


O 32 “■ <224 


1 _ £-“31^ 1 _ q-O'SI-T — g-°14^ 

031(0) = 1 — ■ 

^ 031 ai 4 O31-O14 

The necessary and sufficient condition for the regime 19 (that precedes regime 26) 
to be preceded by regime 22 is given as 


• P 23 ( 0 ) < P 2 i( 0 ) where P23(0) is given as 

P23(0) = P 23{ ts 2) e '^^'’^ + (1 - ( 1/^23 + 1/031 + I/^h) 

0140236 °^^^^^^ _ g-a23t32) 

031(014 - 03 l )(031 - O23) 

014(031 - 0 i 4 )( 0 i 4 - O23) 

where P 23 (ts 2 ) hi the Equation (5.79) above is given as 


P23{ts.) = + (1 " (1/023 + Va32 + 1 /^ 24 ) 

O 24 O 23 O ^ g“23(^32~^*l^) 

032(024 — 032 ) (O 32 — O 23 ) 

024('232 - 024)(024 “ O 23 ) 


(5.80) 
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Note that P 23 (fsi) in the Equation (5.80) above is given by 


2 — 2 — g“34(^3j 1 ') g®23(^>l~2^) g<*34(fji ~7’) 

PTzitsJ = + + 


<323 


^34 


(<323 — 334 ) 


An(d the term P2i(0) is given by 

P2l(0) = 


2 — g~“2i3’ 2 — e~“2in _ g-^wr 

+ + 


021 


014 


(021 — O 14 ) 


It can be argued that regimes 20 and 22 which precede the regime 29 are the starting 
regimes. 

The necessary and sufficient conditions under which the regime 26 is preceded by 
regime 20 can be stated as follows: 

(i) p2i(0) < P24(0) where P 2 i{t) and p 24 (f) are given by the Equations (5.53) and 
(5.55) respectively. 

(ii) Let the instant at which p 2 i (f) and p 24 (f) intersect be at t = ts^. Then psiitsz) < 
P 3 iM where p 32 {t) and p 3 i(t) are given by the Equations (5.57) and (5.56) 
respectively. 

Assume that the above conditions are satisfied and therefore the regime 26 is 
preceded by regime 20. Based on the properties of the costate variables in the 
regime 20, it can be argued that the only regime that could possibly precede the 
regime 20 is regimes 19. The necessary and sufficient conditions under which 
regime 20 is preceded by regime 19 is given as : 

• P3i(0) < P3z(0) where p 3 i(f) is given by the Equation (5.56) andp 32 (f) is given 
by the following expression : 

P32{t) = (1/032 + I/021 + 1/ aw) 

<321 (aw ~ a2i)(a2i — a32) 

^ aw(a 2 i - aw) (aw - (^ 32 ) 

where P 32 {ts.) above is obtained by evaluation the expression (5.57) at t = ts.. 



5.5 The direct links with different parameters 


230 


The regime 19 will in turn be preceded by regime 22 if P 23 (0) < p 2 i (0) where P 23 (t) is 
given by the Equation (5.76) and p 2 i{t) is given by the Equation (5.53). The instant 
of switching from regime 22 to regime 19 is obtained by solving the equation 
P 23 {i) = P 2 i(f)- It can be argued that the regime 22 is the starting regime. 

Finally let us consider the case wherein the regime 26 is preceded by regime 25. 
The necessary and sufficient conditions for the regime 26 to be preceded by regime 
25 can be stated as follows : 

(i) P3i(0) < P32{0) where p 3 i{t) and P 32 {t) are given by the Equations (5.56) and 
(5.57) respectively. 

(ii) Let the instant of switching between P 3 i{t) and P32(f) be at f Then 

PziM >PZ4{ts2)- 

The regime 25 in turn may be preceded by other regimes. Based on the properties 
of the costate variables in the regime 25, it can be argued that the only regimes that 
could possibly precede the regime 25 are 19 and 22. The necessary and sufficient 
conditions for the regime 25 to be preceded by regime 19 are the following : 

(a) P 2 i{ 0 ) < P24(0) where p 2 i{t) and p 24 (f) are given by the Equations (5.53) and 
(5.55) respectively . 

(b) Let the instant at which the functions pzi (t) and p 2 iit) intersect be denoted by 

ThenpTsitss) has to be greater p24(f 53 )- 

The condition (b) above ensures that the regime 25 is not preceded by regime 22. 
If (b) is violated then the regime 25 is preceded by regime 22. It can be argued that 
the only regime that possibly precedes regime 19 is regime 22. The (necessary and 
sufficient) condition imder which the regime 19 is further preceded by regime 22 
is p23(0) < P2i(0) where P 23 (f) is given by the Equation (5.76). Such a regime 22 can 
be argued to be the starting regime. 

The necessary and sufficient conditions under which the regime 25 is preceded by 
regime 22 are given as the following ; 
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(i) P23(0) < P24(0) where p23(i) is given by the Equation (5.76). 

(ii) Let the instant at which pxi{t) and p 2 i{t) intersect be denoted by Then 
^ 21 (^ 53 ) is greater thanp24(^i3)- 

It can be argued, based on the properties of the costate variables in regime 22 (that 
precedes regime 25), that the only regime that could possibly precede the regime 
22 is regime 19. The (necessary and sufficient) condition under which this takes 
place is given by p 2 i( 0 ) < P23(0) where p 23 (i) is given by the Equation (5.76). 

Tlie above discussion exhausts all the possible regime transitions and the switching 
instants for the various cases when the link parameters for the direct links (1,4), 
(2,4) and ( 3 , 4 ) satisfy the relationship > 024 > < 334 - Based on the above discussion 
the possible regime transitions for this case is shown in the Figure 5.30. 

The following observations can be made regarding the optimal routing strategy for 
this case (wherein au > ^24 > < 334 ) • 

(i) Traffic arriving at node 1 is routed onto the direct link (1,4) (which is fastest 

direct link) for the entire duration of network operation. 

(ii) The network operation never enters regime 23 in which the both the routing 
variables q ;23 and 032 sre unity ( loop-free property). 

(iii) The network operation never enters regime 24 in which the traffic arriving at 
the node 2 is sent on the path {(2, 3), (3, 4)} to the destination. This can be 
justified since the link (3,4) is slower than link (2,4) and intuitively it appears 
unreasonable to use an alternate path (at node 2) consisting of a slower link 
than the direct link to the destination. 

The observations (ii) and (iii) above can be extended to the case where au > 034 > 
a 24 and it can be concluded that the network operation never enters regimes 23 and 

26 in this case. 
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Figure 5.30: The possible regime transitions for the case > 024 > a 34 

Remark 5.5.1 : From reasonings similar to the ones employed in the above 
discussion, the following observations can be made regarding the case wherein 

(324 ^ ^14 ^ ^34 • 

(i) The traffic arriving at node 2 is routed onto the direct link (2,4) for the entire 
duration of network operation i.e. 024(0 equals unity for all t G [0, T]. Con- 
sequently the regimes 1, 2, 3, 4, 5, 6, 10, 11, 12, 13, 14, 15, 19, 20, 21, 22, 23 and 
24 are ruled out. 

(ii) The network operation never enters regimes 16 and 18. 
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Similarly for the case wherein 024 > > ai 4 , the network operation never enters 

regimes 1, 2, 3, 4, 5, 6, 10, 11, 12, 13, 14, 15, 16, 19, 20, 21, 22, 23, 24, and 25. 

For the case wherein a 34 > 024 > au, the network operation never enters regimes 
1, 2, 3, 4, 5, 7, 8, 10, 11, 13, 14, 16, 17, 19, 20, 21, 22, 23, 25, and 26. 

For the case wherein 034 > au > < 324 / the network operation never enters regimes 
1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 13, 14, 16, 17, 19, 20, 22, 23, 25 and 26. 

5.6 Suboptimal Strategy 

Our analysis in the previous sections shows that the fastest direct link is used for the 
entire duration of the network operation. Furthermore, under certain additional 
constraints on the link parameters of the network which we stated earlier, the 
optimal routing strategy for the composite network was shown to be the same as 
the one synthesised from the locally optimal routing strategies for the individual 
units. When these constraints are violated, the possible regime transitions and the 
equations to specify them were arrived at A possible way of suboptimally routing 
the packets, which incorporates features of the optimal strategy, and therefore can 
intuitively be expected to achieve a good performance is as follows ; 

• At the source node which has the fastest direct link, route all the incoming the 
traffic onto this direct link for the entire duration of network operation. 

. Consider the two network (three node ) units which share the fastest direct 
link. Synthesise the locally optimal routing strategy for these units. 

In Table 5.8, we give the performance of this suboptimal strategy with the optimal 
strategy for some illustrative examples. Ji is the performance of the optimal 
strategy and J 2 that of the suboptimal strategy. We consider a traffic pattern 
X^(t) = Xzit) = Xsf) = 10, Vt € [0. 10]. The network operation is assumed to be 
for a duration of 10 units and the initial buffer occupancies are assumed to be zero. 
The optimal strategy is obtained by numerically solving the differential equations 
(5.41)-(5.49) in the costate variables. 



Table 5.8: Optimal and Snboptimal Strategies for the Four Node Network: Numerical Examples 
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5.7 Conclusions 

In this chapter, we investigated the problem of optimal routing in some networks 
composed of the primitive -units of the Chapter 3 and Chapter 4. We first considered 
a topology consisting of the two node network units where in m units ( of the total 
n units which constitute the network) have a link (the faster link of the two) of 
finite channel capacity and the remaining (n — m) units have both the links of 
infinite channel capacity. We showed that in the units which have both the links 
of infinite channel capacity, all the incoming traffic is routed onto the faster link 
for the entire duration of network operation. In the other network units, there 
could be intervals of partial routing during which, a fraction of the incoming traffic 
equal to the ratio of the channel capacity of the link to the total incoming traffic to 
the network unit, is sent on the faster link. The properties of the optimal routing 
strategy when these imits are considered in isolation were shown to hold true even 
when they are considered in conjunction with the other units as in the topology 
considered. For the case in which only one imit ( i.e. m = 1) has a link of finite 
charmel capacity, we obtained the set of equations required to specify the optimal 
routing strategy. Solution to these equations requires the knowledge of the load 
pattern for the entire duration of the network operation and hence necessitates an 
off-line computation. We therefore proposed an on-line implementable suboptimal 
strategy for this network. In Section 5.2.3 we compared the performance of this 
suboptimal strategy with that of the optimal strategy and the performance (which 
is the best possible achievable) of the routing strategy if all the links of the network 
were of infinite channel capacity, for the case where m = 1, n = 3. 

We then considered a network topology consisting of the three node primitives of 
the Chapter 4 in the Section 5.3. When all the links of this topology are of infinite 
channel capacity, then the optimal routing strategy for this network is bang-bang 
in nature and is independent of the input traffic. Since this network topology 
is viewed as being composed of simpler three node units, and since the optimal 
ategy for the individual units {locally optimal to the units) canbe specified 
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in terms of a single switching instant (as shown in the Chapter 4 ), it is meaningful 
to compare the performance of such a suboptimal strategy (synthesised from the 
locally optimal strategies) with respect to the performance of the globally optimal 
strategy. We compared the performance of these two strategies for some typical 
values of the link parameters of the network. When one of the links of a unit 
has a direct link of finite channel capacity, a scheme for ensuring that the network 
operates in the linear mode is to reroute the excess traffic (which drives the link 
of finite channel capacity) to the next unit in the same layer of the topology. We 
compared the performance of the network (for various link parameters) operated 
under the globally optimal and the locally optimal strategies with this scheme of 
restricting to the linear mode, implemented. 

Finally in Section 5.4 we investigated the problem of optimal routing in a four- 
node network when all its links are of infinite channel capacity. We proved that the 
network operation ends with a direct routing of the incoming traffic at all the three 
source node. At the source node which has the fastest direct link, the incoming 
traffic is routed onto this link for the entire duration of network operation. We 
showed that under certain conditions on the link parameters, the optimal routing 
strategy for this network is the same as the one synthesised from the locally optimal 
routing strategies for the constituent emits. When these conditions are violated, a 
suboptimal strategy in terms of locally optimal routing strategy for the constituent 
units which share the fastest direct link was proposed and its performance was 
compared with the optimal strategy in the case of some illustrative examples. 



Chapter 6 
Conclusions 


The problem of synthesising routing strategies which optimize the performance 
of a network has drawn much attention in the recent times. A large number 
of them, each one claiming to be better than the other, have been suggested by 
various authors in this context. Based on how these routing strategies incorporate 
the variations in the traffic and/or the network conditions, they can be broadly 
classified into static, qiiasistatic and dynamic routing strategies. In static routing, the 
fractions of the traffic routed onto the outgoing liaks at each node of the network 
are fixed in time, and are decided upon before the network starts operation. In 
quasistatic routing, changes in routes take place at given instants of time and/or 
whenever extreme conditions such as a link failure occur within the network. 
Dynamic routing incorporates continuous changing of routes depending upon the 
instantaneous system states and traffic conditions. The growing need to incorporate 
adaptivity to the variations in the traffic and/or the network conditions in order 
to improve the performance (of the network) has resulted in a shift in trend from 
static routing to dynamic routing strategies. Such a shift is perceived in the context 
of circuit-switched networks also. 

A survey of the literature on routing suggests that intuition, heuristics and 
simulation rather than a thorough analysis, have often been the guiding factors 
in the choice of the routing algorithms in many of the existing networks. While 
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this may be attributed, in part, to the ever increasing need of network community 
to come up with practically more efficient routing strategies, it also motivates the 
need to have theoretical frameworks for the study of them. A major (theoretical) 
contribution in this direction in terms of providing a systematic approach to the 
synthesis of flow control and routing strategies was made by Filipiak in [21]. The 
approach adopted by Filipiak was to model the network as a dynamical system 
using flow models. The basic model of dynamic flows relates the growth in the 
amount of packets/ messages in the system at time t, by means of a deterministic 
differential equation, to the intensity of newly arriving traffic, the intensity of traffic 
discarded/ rejected by the system and the intensity of successfully delivered traffic. 
It was assumed that the intensity of the outgoing traffic can be approximated by 
a non-linear function of the system state. The investigation in this thesis started 
within this framework. We assumed that the flow out from any buffer onto the 
link, will increase with increasing buffer occupancy and will saturate at a value 
equal to the channel capacity of the link. Furthermore, when the buffer is empty 
the flow out will be zero. Based on these assumptions, we considered a model in 
which the flow out function increases linearly with increase in buffer occupancy 
till it reaches the value equal to the channel capacity of the link. Since practical 
networks are subjected to shut downs and need rebooting from time to time, we 
considered a finite time duration operation of the network. 

From the consideration that optimal (or at least good suboptimal) routing strate- 
gies for large networks can be synthesised from those for simpler network units 
that constitute them, we investigated the problem of optimal routing in two such 
simple units, namely a two node unit in Chapter 3 and a three node imit in Chapter 
4. We then considered network topologies which are composed of these imits in 
Chapter 5. The major results which we have derived in this thesis regarding the 
nature of optimal routing in these networks can be stated as the following: 

We first investigated the problem of optimal routing in a two node network 
which has a set of two parallel links between the source and the destination. The 
faster link of the two was assumed to be of finite channel capacity while the slower 
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We argued that the optimal routing strategy has the loop-free property in this case ’ 
too. Of the 27 modes in which the network can operate the optimal routing strategy 
admits only four of these in a terminal interval. 

We then considered the situation where in one of the direct links has finite 
channel capacity. However, the link parameters are such that, if all the links were 
of infinite channel capacity, then the optimal routing strategy would be a direct 
routing at both the source nodes for the entire duration of network operation. 
Under the additional assumption that the buffer occupancy for the link with finite 
channel capacity is below the saturation value, we derived a set of equations in 
terms of the link parameters and the input traffic to the network, required to specify 
the optimal routing strategy. Since the solution to this set of equations requires 
the knowledge of the load pattern for the entire dxuration of network operation 
and this, in turn, necessitates an off-line computation, an on-line implemehtable 
suboptimal strategy was proposed. The optimal and suboptimal strategies were 
illustrated with examples and their performances were also compared. 

We also considered an exponential model for the flow out function for the three 
node topology. We conducted some preliminary munerical investigations from 
which certain interesting observations were made. The optimal routing strategy 
was found to be having the loop-free property. It was also observed that the 
network operation always ends with a direct routing at both the source nodes. 
The optimal routing strategy was foimd to be having the single switching prop- 
erty. However, we did not investigate whether these properties can be analytically 
proved and/ or can be made use of in specifying the routing strategy by means of 
a simple procedure. 

In Chapter 5, we investigated the problem of optimal routing in some networks 
which are composed of the network units of the Chapter 3 and Chapter 4. We 
first considered a topology consisting of the two node network units where in m 
units, of the total n which constitute the topology, have a link of finite channel 
capacity. The faster link of the two was assumed to be of finite channel capacity 
while the slower link was assumed to be of infinite channel capacity. We showed 
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that in the units which have both the links of infinite channel capacity, all the 
incoming traffic is routed onto the faster link for the entire duration of network 
operation. In the other network units, there could be intervals of partial routing 
during which, a fraction of the incoming traffic equal to the ratio of the channel 
capacity of the link to the total incoming traffic to the network unit, is sent on 
the faster link. The properties of the optimal routing strategy when these network 
units were considered in isolation were shown to hold true even when they are 
considered in conjunction with the other units as in the topology considered. For 
the case in which only one unit has a link of finite channel capacity, we derived 
a set of equations (in terms of the link parameters and the input traffic) required 
to specify the optimal routing strategy. Solution to these equations requires the 
knowledge of the load pattern for the entire duration of network operation and 
this, in turn, necessitates an off-line computation. We therefore proposed an on-line 
implementable suboptimal strategy. The optimal and suboptimal strategies were 
illustrated by means of examples and their performances were also compared. 

We considered a network topology consisting of the three node primitives of 
Chapter 4 in Section 5.3. When all the links of this unit are of infinite channel 
capacities, the optimal routing strategy is bang-bang in nature and is mdependent 
of the input traffic. Since this network topology is viewed as being composed of 
simpler three node units, and since the optimal routing strategy for the individual 
units {locally optimal to the units) can be specified in terms of a smgle switchmg 
instant we compared the performance of the globally optimal strategy with that of 
such a suboptimal strategy (which is synthesised from locally optimal strategies for 
the constituent units), in the case of some illustrative examples. We also considered 
a scheme of restricting the traffic so that the network operates in the linear mode, 
even when one of the direct links of one of the network unit has a finite channel 

capacity. 

Finally, we investigated the problem of optimal routing in a four-node hub 
netivork when all its links are of infinite channel capacity. We proved that the 
network operation ends with a direct routing of the incoming traffic at aU the three 
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source node. At the source node which has ihe fastest direct iinic, the incoming 
traffic IS routed onto this link for the entire duration of network operation. We also 
showed that under certain conditions on the link parameters, the optimal routing 
strategy for this network is the same as the one synthesised from the locally optimal 
routing strategies for the constituent units. When these conditions are violated, a 
suboptimal strategy in terms of a locally optimal routing strategy for the constituent 
units (which share the fastest direct link was proposed), and its performance was 
compared with the optimal strategy in the case of some illustrative examples. 

From our studies in this thesis, several interesting possibilities for future work 
emerge. Some of these can be stated as the following: 


• We have not investigated whether there are any computationally efficient 
procedures to solve the system of equations which we derived ( for the two 
node unit in Chapter 3, for the three node unit in Chapter 4 and for the 
composite network of two node units m Chapter 5) for specifying the optimal 
routing strategy. An investigation along this direction would make this study 
complete. 


• We have suggested a suboptimal algorithm for the two node network in 
Chapter 3, for the three node network unit (under certain restrictions on 
the link parameters) in Chapter 4 and for the composite network consisting 
of the two node units in Chapter 5. No quantitative statements about the 
performance of these suboptimal algorithms have been made. It would be 
interesting to investigate whether any bounds on the performance can be 
obtained analytically. 

• Our analysis for the three node unit ends with the case of a single link with fi- 
nite channel capacity. "When more than one link has finite channel capacity, it 
would be interesting to see if optimal routing strategy has the loop-free prop- 
erty. It would also be worthwhile investigating whether a good suboptimal 
algorithm can be suggested for this more general case. 
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• We have given some numerical examples where in the performance of the 
globally optimal routing strategy for the larger networks are compared with that 
of the suboptimal strategy which is synthesised from locally optimal strategies 
for the constituent units. Here again, an investigation on how good such 
a suboptimal strategy is, in comparison with the optimal one, in terms of 
bounds would make the study complete. 

To summarize, this thesis has addressed to the issue of synthesising optimal and/ or 
suboptimal routing strategies in some simple network units and in network topolo- 
gies which are composed of these umts. Although this work can be viewed more 
as theoretical exercise, we do consider that the investigations carried out in this 
thesis and the results obtained, are not without practical implications. 
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